Apr 10 10:26:57 devstack cinder-volume[72335]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 10 10:26:57 devstack cinder-volume[72335]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 10:26:57 devstack cinder-volume[72335]: we strongly recommend against using it for new projects. Apr 10 10:26:57 devstack cinder-volume[72335]: If you are already using Eventlet, we recommend migrating to a different Apr 10 10:26:57 devstack cinder-volume[72335]: framework. For more detail see Apr 10 10:26:57 devstack cinder-volume[72335]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 10:26:57 devstack cinder-volume[72335]: import eventlet # noqa Apr 10 10:26:59 devstack cinder-volume[72335]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72335) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 10:26:59 devstack cinder-volume[72335]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72335) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 10:26:59 devstack cinder-volume[72335]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72335) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 10:27:00 devstack cinder-volume[72335]: INFO dbcounter [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Registered counter for database cinder Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_db.sqlalchemy.engines [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72335) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG dbcounter [-] [72335] Writer thread running {{(pid=72335) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 10:27:00 devstack cinder-volume[72335]: INFO cinder.rpc [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 10 10:27:00 devstack cinder-volume[72335]: INFO cinder.rpc [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_db.sqlalchemy.engines [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72335) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:27:00 devstack cinder-volume[72335]: INFO cinder.volume.manager [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Determined volume DB was empty at startup. Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG cinder.volume.manager [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72335) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 10 10:27:00 devstack cinder-volume[72335]: INFO cinder.volume.manager [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 10 10:27:00 devstack cinder-volume[72335]: WARNING stevedore.named [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 10 10:27:00 devstack cinder-volume[72335]: WARNING castellan.key_manager [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 10:27:00 devstack cinder-volume[72335]: WARNING cinder.keymgr.conf_key_mgr [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG cinder.volume.drivers.lvm [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72335) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_concurrency.processutils [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72335) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_concurrency.processutils [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] CMD "cinder-rtstool verify" returned: 0 in 0.241s {{(pid=72335) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_db.sqlalchemy.engines [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72335) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:27:00 devstack cinder-volume[72335]: INFO cinder.rpc [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 10 10:27:00 devstack cinder-volume[72335]: INFO cinder.rpc [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 10 10:27:00 devstack cinder-volume[72335]: WARNING stevedore.named [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 10 10:27:00 devstack cinder-volume[72335]: WARNING castellan.key_manager [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 10:27:00 devstack cinder-volume[72335]: INFO cinder.volume.manager [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_db.sqlalchemy.engines [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72335) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:27:00 devstack cinder-volume[72335]: INFO oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Starting 1 workers Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Started child 72437 {{(pid=72335) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Full set of CONF: {{(pid=72335) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] ******************************************************************************** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Configuration options gathered from: {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 10 10:27:00 devstack cinder-volume[72437]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] ================================================================================ {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] allow_availability_zone_fallback = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] allow_compression_on_image_upload = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] allowed_direct_url_schemes = [] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] api_rate_limit = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] auth_strategy = keystone {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] az_cache_duration = 3600 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_availability_zone = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_host = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_name = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_stats_polling_interval = 60 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backup_api_class = cinder.backup.api.API {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backup_name_template = backup-%s {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backup_use_same_host = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backup_use_temp_snapshot = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] chap_password = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] chap_username = {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cinder_internal_tenant_project_id = a68862ab4b7a4fae88af82aba48e10fb {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cinder_internal_tenant_user_id = 2ad03d9ba0794c289abdc790fd6642eb {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cloned_volume_same_az = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cluster = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] compression_format = gzip {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] compute_api_class = cinder.compute.nova.API {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] config_dir = [] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] config_source = [] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] control_exchange = openstack {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] debug = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] default_availability_zone = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] default_group_type = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] default_volume_type = lvmdriver-1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] disk_geometry = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] driver_client_cert = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] driver_client_cert_key = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] driver_data_namespace = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] driver_ssl_cert_path = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] driver_ssl_cert_verify = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] driver_use_ssl = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] enable_force_upload = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] enable_new_services = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] enable_unsupported_driver = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72437]: INFO cinder.volume.manager [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] enabled_backends = ['lvmdriver-1'] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] enforce_multipath_for_image_xfer = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] filter_function = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] glance_api_insecure = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] glance_api_servers = ['http://192.168.122.66/image'] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] glance_api_ssl_compression = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] glance_ca_certificates_file = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] glance_catalog_info = image:glance:publicURL {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] glance_certfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] glance_keyfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] glance_num_retries = 3 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] glance_request_timeout = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] goodness_function = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] graceful_shutdown_timeout = 5 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] group_api_class = cinder.group.api.API {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] host = devstack {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] image_compress_on_upload = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] image_conversion_address_space_limit = 1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] image_conversion_cpu_limit = 60 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] image_conversion_disable = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] image_upload_use_cinder_backend = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] image_upload_use_internal_tenant = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] image_volume_cache_enabled = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] image_volume_cache_max_count = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] image_volume_cache_max_size_gb = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] init_host_max_objects_retrieval = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] instance_format = [instance: %(uuid)s] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] iscsi_target_flags = {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] iscsi_write_cache = on {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] iser_helper = tgtadm {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] iser_ip_address = 192.168.122.66 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] iser_port = 3260 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] log_color = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] log_config_append = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] log_dir = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] log_file = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] log_options = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] log_rotate_interval = 1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] log_rotate_interval_type = days {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] log_rotation_type = none {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] max_age = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] max_logfile_count = 30 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] max_logfile_size_mb = 200 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] max_over_subscription_ratio = 20.0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] message_reap_interval = 86400 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] message_ttl = 2592000 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] migration_create_volume_timeout_secs = 300 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] monkey_patch = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] monkey_patch_modules = [] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] my_ip = 192.168.122.66 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] no_snapshot_gb_quota = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] num_iser_scan_tries = 3 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] num_shell_tries = 3 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] num_volume_device_scan_tries = 3 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] nvmeof_conn_info_version = 1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] nvmet_ns_id = 10 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] nvmet_port_id = 1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] osapi_max_limit = 1000 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] osapi_volume_ext_list = [] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] osapi_volume_listen = 0.0.0.0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] osapi_volume_listen_port = 8776 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] osapi_volume_use_ssl = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] osapi_volume_workers = 2 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] per_volume_size_limit = -1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] periodic_fuzzy_delay = 60 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] periodic_interval = 60 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] project_id_regex = [0-9a-f\-]+ {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] public_endpoint = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] publish_errors = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] quota_backup_gigabytes = 1000 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] quota_backups = 10 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] quota_gigabytes = 1000 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] quota_groups = 10 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] quota_snapshots = 10 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] quota_volumes = 10 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] rate_limit_burst = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] rate_limit_except_level = CRITICAL {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] rate_limit_interval = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] reinit_driver_count = 3 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] replication_device = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] report_discard_supported = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] report_interval = 120 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] reservation_clean_interval = 86400 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] reservation_expire = 86400 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] reserved_image_namespaces = [] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] reserved_percentage = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] rpc_response_timeout = 120 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] run_external_periodic_tasks = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] scst_target_driver = iscsi {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] scst_target_iqn_name = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] service_down_time = 720 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] shell_completion = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] snapshot_name_template = snapshot-%s {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] snapshot_same_host = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] split_loggers = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] state_path = /opt/stack/data/cinder {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] storage_availability_zone = nova {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] storage_protocol = iSCSI {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] syslog_log_facility = LOG_USER {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] target_helper = lioadm {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] target_ip_address = 192.168.122.66 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] target_port = 3260 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] target_protocol = iscsi {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] target_secondary_ip_addresses = [] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] trace_flags = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] transfer_api_class = cinder.transfer.api.API {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] transport_url = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] until_refresh = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] use_chap_auth = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] use_default_quota_class = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] use_journal = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] use_json = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] use_multipath_for_image_xfer = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] use_stderr = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] use_syslog = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] verify_glance_signatures = enabled {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] volume_api_class = cinder.volume.api.API {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] volume_backend_name = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] volume_clear = zero {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] volume_clear_ionice = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] volume_clear_size = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] volume_copy_bps_limit = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] volume_dd_blocksize = 1M {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] volume_name_template = volume-%s {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] volume_service_inithost_offload = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] volume_usage_audit_period = month {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] zoning_mode = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_concurrency.disable_process_locking = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.admin_password = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.admin_token = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.admin_user = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.auth_admin_prefix = {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.auth_port = 35357 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.auth_protocol = https {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.auth_section = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.auth_type = password {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.auth_uri = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.auth_version = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.cache = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.certfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.delay_auth_decision = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.http_connect_timeout = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.identity_uri = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.include_service_catalog = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.insecure = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.interface = public {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.keyfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.memcache_password = {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack sudo[72441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 10 10:27:00 devstack sudo[72441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.memcache_username = {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.region_name = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.service_token_roles_required = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.service_type = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.token_cache_time = 300 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.66/identity {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.backend = dogpile.cache.null {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.backend_argument = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.backend_expiration_time = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.config_prefix = cache.oslo {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.debug_cache_backend = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.enable_retry_client = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.enable_socket_keepalive = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.enabled = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.enforce_fips_mode = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.expiration_time = 600 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.hashclient_retry_attempts = 2 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.memcache_dead_retry = 300 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.memcache_pool_maxsize = 10 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.memcache_sasl_enabled = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.password = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.proxies = [] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.redis_db = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.redis_sentinel_service_name = mymaster {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.redis_server = localhost:6379 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.retry_attempts = 2 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.retry_delay = 0.0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.socket_keepalive_count = 1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.socket_keepalive_idle = 1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.socket_keepalive_interval = 1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.socket_timeout = 1.0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.tls_allowed_ciphers = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.tls_cafile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.tls_certfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.tls_enabled = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.tls_keyfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cache.username = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] coordination.backend_url = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] database.asyncio_connection = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] database.asyncio_slave_connection = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] database.backend = sqlalchemy {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] database.connection = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] database.connection_debug = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] database.connection_parameters = {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] database.connection_recycle_time = 3600 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] database.connection_trace = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] database.db_inc_retry_interval = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] database.db_max_retries = 20 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] database.db_max_retry_interval = 10 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] database.db_retry_interval = 1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] database.max_overflow = 50 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] database.max_pool_size = 5 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] database.max_retries = 10 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] database.mysql_wsrep_sync_wait = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] database.pool_timeout = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] database.retry_interval = 10 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] database.slave_connection = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] database.sqlite_synchronous = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] database.synchronous_reader = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] database.use_db_reconnect = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] profiler.connection_string = messaging:// {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] profiler.enabled = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] profiler.es_doc_type = notification {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] profiler.es_scroll_size = 10000 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] profiler.es_scroll_time = 2m {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] profiler.filter_error_trace = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] profiler.hmac_keys = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] profiler.sentinel_service_name = mymaster {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] profiler.socket_timeout = 0.1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] profiler.trace_requests = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] profiler.trace_sqlalchemy = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] profiler_jaeger.process_tags = {} {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] profiler_jaeger.service_name_prefix = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] profiler_otlp.service_name_prefix = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_policy.enforce_new_defaults = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: WARNING oslo_config.cfg [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_policy.enforce_scope = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_policy.policy_default_rule = default {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_policy.policy_file = policy.yaml {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_policy.remote_timeout = 60.0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] privsep_osbrick.group = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] privsep_osbrick.helper_command = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] privsep_osbrick.user = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cinder_sys_admin.group = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cinder_sys_admin.helper_command = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] cinder_sys_admin.user = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] service_user.auth_section = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] service_user.auth_type = password {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] service_user.cafile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] service_user.certfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] service_user.collect_timing = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] service_user.insecure = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] service_user.keyfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] service_user.send_service_user_token = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] service_user.split_loggers = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] service_user.timeout = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] glance.auth_section = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] glance.auth_type = password {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] glance.certfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] glance.collect_timing = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] glance.insecure = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] glance.keyfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] glance.region_name = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] glance.split_loggers = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] glance.timeout = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.backend_availability_zone = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.chap_password = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.chap_username = {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.disk_geometry = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.driver_client_cert = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.driver_client_cert_key = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.driver_data_namespace = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.driver_use_ssl = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.enable_unsupported_driver = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.extra_capabilities = {} {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.filter_function = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.goodness_function = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.iscsi_target_flags = {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.iscsi_write_cache = on {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.iser_helper = tgtadm {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.iser_ip_address = 192.168.122.66 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.iser_port = 3260 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.lvm_mirrors = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.lvm_share_target = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.lvm_type = auto {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.num_shell_tries = 3 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.nvmet_port_id = 1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.replication_device = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.report_discard_supported = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.reserved_percentage = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.scst_target_driver = iscsi {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.scst_target_iqn_name = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.storage_protocol = iSCSI {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.target_helper = tgtadm {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.target_ip_address = 192.168.122.66 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.target_port = 3260 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.target_protocol = iscsi {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.trace_flags = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.unique_fqdn_network = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.use_chap_auth = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.volume_backend_name = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.volume_clear = zero {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.volume_clear_ionice = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.volume_clear_size = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.volume_group = cinder-volumes {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_reports.file_event_handler = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_reports.log_dir = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.backend_availability_zone = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.backend_host = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.chap_password = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.chap_username = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.chiscsi_conf = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.disk_geometry = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.driver_client_cert = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.driver_data_namespace = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.driver_use_ssl = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.extra_capabilities = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.filter_function = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.goodness_function = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.iser_helper = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.iser_ip_address = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.iser_port = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.iser_target_prefix = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.lvm_conf_file = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.lvm_mirrors = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.lvm_share_target = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.lvm_type = auto {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.num_shell_tries = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.nvmet_port_id = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.replication_device = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.report_discard_supported = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.reserved_percentage = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.scst_target_driver = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.storage_protocol = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.target_helper = lioadm {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.target_ip_address = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.target_port = 3260 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.target_protocol = iscsi {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.trace_flags = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.use_chap_auth = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.volume_clear = zero {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.volume_clear_size = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] lvmdriver-1.volumes_dir = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.ssl = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.ssl_version = {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_notifications.driver = [] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_notifications.retry = -1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] oslo_messaging_notifications.transport_url = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] key_manager.fixed_key = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] barbican.barbican_api_version = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] barbican.barbican_endpoint = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] barbican.barbican_endpoint_type = public {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] barbican.barbican_region_name = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] barbican.cafile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] barbican.certfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] barbican.collect_timing = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] barbican.insecure = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] barbican.keyfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] barbican.number_of_retries = 60 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] barbican.retry_delay = 1 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] barbican.send_service_user_token = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] barbican.split_loggers = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] barbican.timeout = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] barbican.verify_ssl = True {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] barbican.verify_ssl_path = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] barbican_service_user.auth_section = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] barbican_service_user.auth_type = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] barbican_service_user.cafile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] barbican_service_user.certfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] barbican_service_user.collect_timing = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] barbican_service_user.insecure = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] barbican_service_user.keyfile = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] barbican_service_user.split_loggers = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] barbican_service_user.timeout = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] vault.approle_role_id = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] vault.approle_secret_id = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] vault.kv_mountpoint = secret {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] vault.kv_path = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] vault.kv_version = 2 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] vault.namespace = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] vault.root_token_id = **** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] vault.ssl_ca_crt_file = None {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] vault.timeout = 60.0 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] vault.use_ssl = False {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:00 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] ******************************************************************************** {{(pid=72335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 10 10:27:01 devstack sudo[72441]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:01 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.567s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:01 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:01 devstack sudo[72444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:27:01 devstack sudo[72444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:01 devstack sudo[72444]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:01 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.535s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:01 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:27:01 devstack cinder-volume[72437]: INFO cinder.brick.local_dev.lvm [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 10 10:27:01 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:01 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.012s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:01 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:01 devstack sudo[72730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 10:27:01 devstack sudo[72730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:02 devstack sudo[72730]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:02 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.521s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:02 devstack cinder-volume[72437]: DEBUG cinder.brick.local_dev.lvm [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72437) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 10 10:27:02 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:02 devstack sudo[72929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:27:02 devstack sudo[72929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:03 devstack sudo[72929]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:03 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.974s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:03 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:03 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:03 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:03 devstack sudo[73120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:27:03 devstack sudo[73120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:03 devstack sudo[73120]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:03 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.492s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:03 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:03 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:03 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:03 devstack sudo[73128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 10 10:27:03 devstack sudo[73128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:04 devstack sudo[73128]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:04 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.443s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:04 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:04 devstack sudo[73131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 10:27:04 devstack sudo[73131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:04 devstack sudo[73131]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:04 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.435s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:04 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:04 devstack sudo[73136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 10:27:04 devstack sudo[73136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:05 devstack sudo[73136]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:05 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.452s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:05 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:05 devstack sudo[73139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:27:05 devstack sudo[73139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:05 devstack sudo[73139]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:05 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.492s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:05 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:05 devstack sudo[73144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:27:05 devstack sudo[73144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:06 devstack sudo[73144]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:06 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.450s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:06 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:06 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:06 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:06 devstack sudo[73151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:27:06 devstack sudo[73151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:06 devstack sudo[73151]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:06 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.545s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:06 devstack cinder-volume[72437]: INFO cinder.volume.drivers.lvm [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 10 10:27:06 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:06 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:06 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:06 devstack sudo[73226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:27:06 devstack sudo[73226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:07 devstack sudo[73226]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:07 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.445s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:07 devstack cinder-volume[72437]: DEBUG cinder.volume.drivers.lvm [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Updating volume stats {{(pid=72437) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 10:27:07 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:07 devstack sudo[73273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 10:27:07 devstack sudo[73273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:07 devstack sudo[73273]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:07 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.466s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:07 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:07 devstack sudo[73411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:27:07 devstack sudo[73411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:08 devstack sudo[73411]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:08 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.483s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:08 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:08 devstack sudo[73417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:27:08 devstack sudo[73417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:08 devstack sudo[73417]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:08 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.487s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:08 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:08 devstack sudo[73420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:27:08 devstack sudo[73420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:09 devstack sudo[73420]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:09 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.464s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:09 devstack cinder-volume[72437]: INFO cinder.volume.driver [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Driver hasn't implemented _init_vendor_properties() Apr 10 10:27:09 devstack cinder-volume[72437]: DEBUG cinder.volume.driver [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72437) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 10 10:27:09 devstack cinder-volume[72437]: DEBUG oslo_db.sqlalchemy.engines [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72437) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:27:09 devstack cinder-volume[72437]: DEBUG dbcounter [-] [72437] Writer thread running {{(pid=72437) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 10:27:09 devstack cinder-volume[72437]: DEBUG cinder.db.sqlalchemy.api [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Building query based on filter {{(pid=72437) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 10 10:27:09 devstack cinder-volume[72437]: DEBUG cinder.image.image_utils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72437) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 10 10:27:09 devstack cinder-volume[72437]: INFO cinder.keymgr.migration [None req-9eefc63d-b81a-4d54-bbec-5f3828cc0f23 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 10 10:27:09 devstack cinder-volume[72437]: DEBUG cinder.volume.drivers.lvm [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Updating volume stats {{(pid=72437) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 10:27:09 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:09 devstack sudo[73425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 10:27:09 devstack sudo[73425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:09 devstack sudo[73425]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:09 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.493s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:09 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:09 devstack sudo[73429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:27:09 devstack sudo[73429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:10 devstack sudo[73429]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:10 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.469s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:10 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:10 devstack sudo[73437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:27:10 devstack sudo[73437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:10 devstack cinder-volume[72335]: DEBUG dbcounter [-] [72335] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72335) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:27:10 devstack sudo[73437]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:10 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.480s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:10 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:10 devstack sudo[73442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:27:10 devstack sudo[73442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:11 devstack sudo[73442]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:11 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.517s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:11 devstack cinder-volume[72437]: DEBUG cinder.manager [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Notifying Schedulers of capabilities ... {{(pid=72437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:27:11 devstack cinder-volume[72437]: INFO cinder.volume.manager [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Driver initialization completed successfully. Apr 10 10:27:11 devstack cinder-volume[72437]: INFO cinder.manager [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Initiating service 2 cleanup Apr 10 10:27:11 devstack cinder-volume[72437]: INFO cinder.manager [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Service 2 cleanup completed. Apr 10 10:27:11 devstack cinder-volume[72437]: DEBUG cinder.service [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Creating RPC server for service cinder-volume {{(pid=72437) start /opt/stack/cinder/cinder/service.py:231}} Apr 10 10:27:11 devstack cinder-volume[72437]: DEBUG cinder.service [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72437) start /opt/stack/cinder/cinder/service.py:237}} Apr 10 10:27:11 devstack cinder-volume[72437]: INFO cinder.volume.manager [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 10 10:27:11 devstack cinder-volume[72437]: DEBUG cinder.volume.drivers.lvm [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Updating volume stats {{(pid=72437) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 10:27:11 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:11 devstack sudo[73447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 10:27:11 devstack sudo[73447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:11 devstack sudo[73447]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:11 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.486s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:11 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:11 devstack sudo[73476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:27:11 devstack sudo[73476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:12 devstack sudo[73476]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:12 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.443s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:12 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:12 devstack sudo[73511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:27:12 devstack sudo[73511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:12 devstack sudo[73511]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:12 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.439s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:12 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:12 devstack sudo[73514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:27:12 devstack sudo[73514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:13 devstack sudo[73514]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:13 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:13 devstack cinder-volume[72437]: INFO cinder.volume.manager [None req-7e6080e4-5253-40e8-8c4a-708066f4da1e None None] Driver post RPC initialization completed successfully. Apr 10 10:27:21 devstack cinder-volume[72437]: DEBUG dbcounter [-] [72437] Writing DB stats cinder:SELECT=3 {{(pid=72437) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:27:23 devstack cinder-volume[72437]: DEBUG dbcounter [-] [72437] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72437) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:28:58 devstack cinder-volume[72437]: DEBUG oslo_service.periodic_task [None req-a5e79e98-f654-4ba1-9be7-073c90b575a3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72437) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:28:58 devstack cinder-volume[72437]: DEBUG cinder.volume.drivers.lvm [None req-a5e79e98-f654-4ba1-9be7-073c90b575a3 None None] Updating volume stats {{(pid=72437) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 10:28:58 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-a5e79e98-f654-4ba1-9be7-073c90b575a3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:28:58 devstack sudo[78567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 10:28:58 devstack sudo[78567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:28:58 devstack sudo[78567]: pam_unix(sudo:session): session closed for user root Apr 10 10:28:58 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-a5e79e98-f654-4ba1-9be7-073c90b575a3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.436s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:28:58 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-a5e79e98-f654-4ba1-9be7-073c90b575a3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:28:58 devstack sudo[78573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:28:58 devstack sudo[78573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:28:59 devstack sudo[78573]: pam_unix(sudo:session): session closed for user root Apr 10 10:28:59 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-a5e79e98-f654-4ba1-9be7-073c90b575a3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:28:59 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-a5e79e98-f654-4ba1-9be7-073c90b575a3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:28:59 devstack sudo[78576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:28:59 devstack sudo[78576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:28:59 devstack sudo[78576]: pam_unix(sudo:session): session closed for user root Apr 10 10:28:59 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-a5e79e98-f654-4ba1-9be7-073c90b575a3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.434s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:28:59 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-a5e79e98-f654-4ba1-9be7-073c90b575a3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:28:59 devstack sudo[78584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:28:59 devstack sudo[78584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:28:59 devstack sudo[78584]: pam_unix(sudo:session): session closed for user root Apr 10 10:28:59 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-a5e79e98-f654-4ba1-9be7-073c90b575a3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:28:59 devstack cinder-volume[72437]: DEBUG cinder.manager [None req-a5e79e98-f654-4ba1-9be7-073c90b575a3 None None] Notifying Schedulers of capabilities ... {{(pid=72437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:29:23 devstack cinder-volume[72437]: DEBUG dbcounter [-] [72437] Writing DB stats cinder:SELECT=1 {{(pid=72437) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:29:23 devstack cinder-volume[72437]: DEBUG dbcounter [-] [72437] Writing DB stats cinder:UPDATE=1 {{(pid=72437) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:29:58 devstack cinder-volume[72437]: DEBUG oslo_service.periodic_task [None req-a5e79e98-f654-4ba1-9be7-073c90b575a3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72437) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:29:58 devstack cinder-volume[72437]: DEBUG cinder.volume.drivers.lvm [None req-a5e79e98-f654-4ba1-9be7-073c90b575a3 None None] Updating volume stats {{(pid=72437) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 10:29:58 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-a5e79e98-f654-4ba1-9be7-073c90b575a3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:29:58 devstack sudo[80718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 10:29:58 devstack sudo[80718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:29:58 devstack sudo[80718]: pam_unix(sudo:session): session closed for user root Apr 10 10:29:58 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-a5e79e98-f654-4ba1-9be7-073c90b575a3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:29:58 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-a5e79e98-f654-4ba1-9be7-073c90b575a3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:29:58 devstack sudo[80721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:29:58 devstack sudo[80721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:29:59 devstack sudo[80721]: pam_unix(sudo:session): session closed for user root Apr 10 10:29:59 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-a5e79e98-f654-4ba1-9be7-073c90b575a3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.440s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:29:59 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-a5e79e98-f654-4ba1-9be7-073c90b575a3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:29:59 devstack sudo[80724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:29:59 devstack sudo[80724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:29:59 devstack sudo[80724]: pam_unix(sudo:session): session closed for user root Apr 10 10:29:59 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-a5e79e98-f654-4ba1-9be7-073c90b575a3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.452s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:29:59 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-a5e79e98-f654-4ba1-9be7-073c90b575a3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:29:59 devstack sudo[80737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:29:59 devstack sudo[80737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:29:59 devstack sudo[80737]: pam_unix(sudo:session): session closed for user root Apr 10 10:29:59 devstack cinder-volume[72437]: DEBUG oslo_concurrency.processutils [None req-a5e79e98-f654-4ba1-9be7-073c90b575a3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=72437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:29:59 devstack cinder-volume[72437]: DEBUG cinder.manager [None req-a5e79e98-f654-4ba1-9be7-073c90b575a3 None None] Notifying Schedulers of capabilities ... {{(pid=72437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:30:26 devstack cinder-volume[72335]: INFO oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Caught SIGTERM, stopping children Apr 10 10:30:26 devstack cinder-volume[72335]: DEBUG oslo_concurrency.lockutils [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Acquiring lock "singleton_lock" {{(pid=72335) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 10:30:26 devstack cinder-volume[72335]: DEBUG oslo_concurrency.lockutils [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Acquired lock "singleton_lock" {{(pid=72335) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 10:30:26 devstack cinder-volume[72335]: DEBUG oslo_concurrency.lockutils [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Releasing lock "singleton_lock" {{(pid=72335) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 10:30:26 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Stop services. {{(pid=72335) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 10 10:30:26 devstack cinder-volume[72335]: DEBUG oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Killing children. {{(pid=72335) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 10 10:30:26 devstack cinder-volume[72335]: INFO oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Waiting on 1 children to exit Apr 10 10:30:31 devstack cinder-volume[72437]: DEBUG oslo_concurrency.lockutils [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Acquiring lock "singleton_lock" {{(pid=72437) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 10:30:31 devstack cinder-volume[72437]: DEBUG oslo_concurrency.lockutils [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Acquired lock "singleton_lock" {{(pid=72437) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 10:30:31 devstack cinder-volume[72437]: DEBUG oslo_concurrency.lockutils [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Releasing lock "singleton_lock" {{(pid=72437) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 10:30:31 devstack cinder-volume[72437]: WARNING amqp [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 10 10:30:31 devstack cinder-volume[72437]: WARNING amqp [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 10 10:30:31 devstack cinder-volume[72335]: INFO oslo_service.backend._eventlet.service [None req-a2bd2707-82b6-40ee-b292-433bfd2c151b None None] Child 72437 exited with status 0 Apr 10 10:30:31 devstack cinder-volume[81446]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 10 10:30:31 devstack cinder-volume[81446]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 10:30:31 devstack cinder-volume[81446]: we strongly recommend against using it for new projects. Apr 10 10:30:31 devstack cinder-volume[81446]: If you are already using Eventlet, we recommend migrating to a different Apr 10 10:30:31 devstack cinder-volume[81446]: framework. For more detail see Apr 10 10:30:31 devstack cinder-volume[81446]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 10:30:31 devstack cinder-volume[81446]: import eventlet # noqa Apr 10 10:30:33 devstack cinder-volume[81446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 10:30:33 devstack cinder-volume[81446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 10:30:33 devstack cinder-volume[81446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 10:30:34 devstack cinder-volume[81446]: INFO dbcounter [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] Registered counter for database cinder Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_db.sqlalchemy.engines [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81446) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG dbcounter [-] [81446] Writer thread running {{(pid=81446) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 10:30:34 devstack cinder-volume[81446]: INFO cinder.rpc [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 10 10:30:34 devstack cinder-volume[81446]: INFO cinder.rpc [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_db.sqlalchemy.engines [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81446) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:30:34 devstack cinder-volume[81446]: INFO cinder.volume.manager [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] Determined volume DB was empty at startup. Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG cinder.volume.manager [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81446) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 10 10:30:34 devstack cinder-volume[81446]: INFO cinder.volume.manager [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 10 10:30:34 devstack cinder-volume[81446]: WARNING stevedore.named [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 10 10:30:34 devstack cinder-volume[81446]: WARNING castellan.key_manager [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 10:30:34 devstack cinder-volume[81446]: WARNING cinder.keymgr.conf_key_mgr [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 10:30:34 devstack cinder-volume[81446]: INFO cinder.volume.manager [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_db.sqlalchemy.engines [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81446) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:30:34 devstack cinder-volume[81446]: INFO oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] Starting 1 workers Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] Started child 81564 {{(pid=81446) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] Full set of CONF: {{(pid=81446) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] ******************************************************************************** {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] Configuration options gathered from: {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] ================================================================================ {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] allow_availability_zone_fallback = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] allow_compression_on_image_upload = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] allowed_direct_url_schemes = [] {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] api_rate_limit = True {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] auth_strategy = keystone {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_availability_zone = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_host = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_name = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_stats_polling_interval = 60 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backup_api_class = cinder.backup.api.API {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backup_name_template = backup-%s {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backup_use_same_host = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backup_use_temp_snapshot = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] chap_password = **** {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] chap_username = {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cinder_internal_tenant_project_id = a68862ab4b7a4fae88af82aba48e10fb {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cinder_internal_tenant_user_id = 2ad03d9ba0794c289abdc790fd6642eb {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cluster = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] compression_format = gzip {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] compute_api_class = cinder.compute.nova.API {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] config_dir = [] {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] config_source = [] {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] control_exchange = openstack {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] debug = True {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] default_availability_zone = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] default_group_type = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81564]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] default_volume_type = QuobyteHD {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] disk_geometry = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] driver_client_cert = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] driver_client_cert_key = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] driver_data_namespace = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] driver_ssl_cert_path = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] driver_ssl_cert_verify = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] driver_use_ssl = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] enable_new_services = True {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] enable_unsupported_driver = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] enabled_backends = ['QuobyteHD'] {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] enforce_multipath_for_image_xfer = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] filter_function = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] glance_api_insecure = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] glance_api_servers = ['http://192.168.122.66/image'] {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] glance_api_ssl_compression = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] glance_ca_certificates_file = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] glance_catalog_info = image:glance:publicURL {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] glance_certfile = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] glance_keyfile = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] glance_num_retries = 3 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] glance_request_timeout = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] goodness_function = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] graceful_shutdown_timeout = 5 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] group_api_class = cinder.group.api.API {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] host = devstack {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] image_compress_on_upload = True {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] image_conversion_address_space_limit = 1 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] image_conversion_cpu_limit = 60 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] image_conversion_disable = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] image_upload_use_cinder_backend = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] image_upload_use_internal_tenant = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] image_volume_cache_enabled = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] image_volume_cache_max_count = 0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] image_volume_cache_max_size_gb = 0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] init_host_max_objects_retrieval = 0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] instance_format = [instance: %(uuid)s] {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] iscsi_target_flags = {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] iscsi_write_cache = on {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] iser_helper = tgtadm {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] iser_ip_address = 192.168.122.66 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] iser_port = 3260 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] log_color = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] log_config_append = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] log_dir = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] log_file = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] log_options = True {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] log_rotate_interval = 1 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] log_rotate_interval_type = days {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] log_rotation_type = none {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] max_age = 0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] max_logfile_count = 30 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] max_logfile_size_mb = 200 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] max_over_subscription_ratio = 20.0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] message_reap_interval = 86400 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] message_ttl = 2592000 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] migration_create_volume_timeout_secs = 300 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] monkey_patch = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] monkey_patch_modules = [] {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] my_ip = 192.168.122.66 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] no_snapshot_gb_quota = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] num_iser_scan_tries = 3 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] num_shell_tries = 3 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] num_volume_device_scan_tries = 3 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] nvmeof_conn_info_version = 1 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] nvmet_ns_id = 10 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] nvmet_port_id = 1 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] osapi_max_limit = 1000 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] osapi_volume_ext_list = [] {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] osapi_volume_listen_port = 8776 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] osapi_volume_use_ssl = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] osapi_volume_workers = 2 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] per_volume_size_limit = -1 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] periodic_fuzzy_delay = 60 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] periodic_interval = 60 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] public_endpoint = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] publish_errors = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] quota_backup_gigabytes = 1000 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] quota_backups = 10 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] quota_gigabytes = 1000 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] quota_groups = 10 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] quota_snapshots = 10 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] quota_volumes = 10 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] rate_limit_burst = 0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] rate_limit_except_level = CRITICAL {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] rate_limit_interval = 0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] reinit_driver_count = 3 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] replication_device = **** {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] report_discard_supported = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] report_interval = 120 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] reservation_clean_interval = 86400 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] reservation_expire = 86400 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] reserved_image_namespaces = [] {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] reserved_percentage = 0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] rpc_response_timeout = 120 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] run_external_periodic_tasks = True {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] scst_target_driver = iscsi {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] scst_target_iqn_name = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] service_down_time = 720 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] shell_completion = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] snapshot_name_template = snapshot-%s {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] split_loggers = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] state_path = /opt/stack/data/cinder {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] storage_availability_zone = nova {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] storage_protocol = iSCSI {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] syslog_log_facility = LOG_USER {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] target_helper = lioadm {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] target_ip_address = 192.168.122.66 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] target_port = 3260 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] target_protocol = iscsi {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] target_secondary_ip_addresses = [] {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] trace_flags = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] transport_url = **** {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] until_refresh = 0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] use_chap_auth = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] use_default_quota_class = True {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] use_journal = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] use_json = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] use_multipath_for_image_xfer = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] use_stderr = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] use_syslog = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] verify_glance_signatures = enabled {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] volume_api_class = cinder.volume.api.API {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] volume_backend_name = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] volume_clear = zero {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] volume_clear_ionice = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] volume_clear_size = 0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] volume_copy_bps_limit = 0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] volume_dd_blocksize = 1M {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] volume_name_template = volume-%s {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] volume_service_inithost_offload = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] volume_usage_audit_period = month {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] zoning_mode = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_concurrency.disable_process_locking = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.admin_password = **** {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.admin_token = **** {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.admin_user = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.auth_port = 35357 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.auth_protocol = https {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.auth_section = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.auth_type = password {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.auth_uri = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.auth_version = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.cache = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.certfile = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.identity_uri = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.include_service_catalog = True {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.insecure = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.interface = public {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.keyfile = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.memcache_password = {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.memcache_username = {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.region_name = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.service_type = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.66/identity {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.backend = dogpile.cache.null {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.backend_argument = **** {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.backend_expiration_time = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.config_prefix = cache.oslo {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.debug_cache_backend = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.enable_retry_client = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.enable_socket_keepalive = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.enabled = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.enforce_fips_mode = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.expiration_time = 600 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.hashclient_retry_attempts = 2 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.memcache_dead_retry = 300 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.memcache_pool_maxsize = 10 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.memcache_sasl_enabled = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.password = **** {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.proxies = [] {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.redis_db = 0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.redis_server = localhost:6379 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.retry_attempts = 2 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.retry_delay = 0.0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.socket_keepalive_count = 1 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.socket_keepalive_idle = 1 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.socket_keepalive_interval = 1 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.socket_timeout = 1.0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.tls_allowed_ciphers = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.tls_cafile = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.tls_certfile = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.tls_enabled = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.tls_keyfile = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cache.username = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] coordination.backend_url = **** {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] database.asyncio_connection = **** {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] database.asyncio_slave_connection = **** {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] database.backend = sqlalchemy {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] database.connection = **** {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] database.connection_debug = 0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] database.connection_parameters = {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] database.connection_recycle_time = 3600 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] database.connection_trace = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] database.db_inc_retry_interval = True {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] database.db_max_retries = 20 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] database.db_max_retry_interval = 10 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] database.db_retry_interval = 1 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] database.max_overflow = 50 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] database.max_pool_size = 5 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] database.max_retries = 10 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] database.mysql_wsrep_sync_wait = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] database.pool_timeout = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] database.retry_interval = 10 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] database.slave_connection = **** {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] database.sqlite_synchronous = True {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] database.synchronous_reader = True {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] database.use_db_reconnect = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] profiler.connection_string = messaging:// {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] profiler.enabled = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] profiler.es_doc_type = notification {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] profiler.es_scroll_size = 10000 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] profiler.es_scroll_time = 2m {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] profiler.filter_error_trace = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] profiler.hmac_keys = **** {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] profiler.sentinel_service_name = mymaster {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] profiler.socket_timeout = 0.1 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] profiler.trace_requests = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] profiler.trace_sqlalchemy = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] profiler_jaeger.process_tags = {} {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] profiler_jaeger.service_name_prefix = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] profiler_otlp.service_name_prefix = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_policy.enforce_new_defaults = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: WARNING oslo_config.cfg [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_policy.enforce_scope = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_policy.policy_default_rule = default {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_policy.policy_file = policy.yaml {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] privsep_osbrick.group = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] privsep_osbrick.helper_command = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] privsep_osbrick.user = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cinder_sys_admin.group = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cinder_sys_admin.helper_command = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] cinder_sys_admin.user = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] service_user.auth_section = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] service_user.auth_type = password {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] service_user.cafile = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] service_user.certfile = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] service_user.collect_timing = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] service_user.insecure = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] service_user.keyfile = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] service_user.send_service_user_token = True {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] service_user.split_loggers = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] service_user.timeout = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] glance.auth_section = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] glance.auth_type = password {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] glance.certfile = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] glance.collect_timing = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] glance.insecure = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] glance.keyfile = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] glance.region_name = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] glance.split_loggers = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] glance.timeout = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.backend_availability_zone = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.chap_password = **** {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.chap_username = {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.disk_geometry = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.driver_client_cert = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.driver_client_cert_key = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.driver_data_namespace = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.driver_use_ssl = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.extra_capabilities = {} {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.filter_function = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.goodness_function = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.iscsi_target_flags = {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.iscsi_write_cache = on {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.iser_helper = tgtadm {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.iser_ip_address = 192.168.122.66 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.iser_port = 3260 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.nas_host = {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.nas_login = admin {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.nas_mount_options = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.nas_password = **** {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.nas_private_key = {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.nas_share_path = {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.num_shell_tries = 3 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.quobyte_volume_url = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.replication_device = **** {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.report_discard_supported = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.reserved_percentage = 0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.target_helper = tgtadm {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81564]: INFO cinder.volume.manager [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Starting volume driver QuobyteDriver (1.1.14) Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.target_ip_address = 192.168.122.66 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.target_port = 3260 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.target_protocol = iscsi {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.trace_flags = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.unique_fqdn_network = True {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.use_chap_auth = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.volume_backend_name = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.volume_clear = zero {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.volume_clear_ionice = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.volume_clear_size = 0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_reports.file_event_handler = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_reports.log_dir = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.backend_availability_zone = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.backend_host = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.chap_password = **** {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.chap_username = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.chiscsi_conf = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.disk_geometry = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.driver_client_cert = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.driver_data_namespace = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.driver_use_ssl = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81564]: DEBUG cinder.volume.drivers.remotefs [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81564) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.extra_capabilities = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.filter_function = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.goodness_function = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.iser_helper = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.iser_ip_address = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.iser_port = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.iser_target_prefix = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.nas_host = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.nas_login = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.nas_mount_options = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.nas_password = **** {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.nas_private_key = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.nas_share_path = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.nas_ssh_port = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.num_shell_tries = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.nvmet_port_id = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.replication_device = **** {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.report_discard_supported = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.reserved_percentage = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.scst_target_driver = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.storage_protocol = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.target_helper = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.target_ip_address = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.target_port = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.target_prefix = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.target_protocol = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.trace_flags = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.use_chap_auth = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.volume_clear = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.volume_clear_size = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] QuobyteHD.volumes_dir = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.ssl = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_notifications.driver = [] {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_notifications.retry = -1 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] key_manager.fixed_key = **** {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] barbican.barbican_api_version = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] barbican.barbican_endpoint = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] barbican.barbican_endpoint_type = public {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] barbican.barbican_region_name = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] barbican.cafile = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] barbican.certfile = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] barbican.collect_timing = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] barbican.insecure = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] barbican.keyfile = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] barbican.number_of_retries = 60 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] barbican.retry_delay = 1 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] barbican.send_service_user_token = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] barbican.split_loggers = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] barbican.timeout = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] barbican.verify_ssl = True {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] barbican.verify_ssl_path = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] barbican_service_user.auth_section = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] barbican_service_user.auth_type = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] barbican_service_user.cafile = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] barbican_service_user.certfile = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] barbican_service_user.collect_timing = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] barbican_service_user.insecure = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] barbican_service_user.keyfile = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] barbican_service_user.split_loggers = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] barbican_service_user.timeout = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] vault.approle_role_id = **** {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] vault.approle_secret_id = **** {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] vault.kv_mountpoint = secret {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] vault.kv_path = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] vault.kv_version = 2 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] vault.namespace = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] vault.root_token_id = **** {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] vault.ssl_ca_crt_file = None {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] vault.timeout = 60.0 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] vault.use_ssl = False {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:34 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] ******************************************************************************** {{(pid=81446) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 10 10:30:34 devstack cinder-volume[81564]: DEBUG cinder.volume.drivers.quobyte [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81564) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 10 10:30:34 devstack cinder-volume[81564]: WARNING cinder.volume.drivers.quobyte [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 10 10:30:34 devstack cinder-volume[81564]: WARNING cinder.volume.drivers.quobyte [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 10 10:30:34 devstack cinder-volume[81564]: DEBUG oslo_concurrency.processutils [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Running cmd (subprocess): mount.quobyte {{(pid=81564) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:30:34 devstack quobyte-client[81565]: Reading configuration file: /etc/quobyte/client.cfg Apr 10 10:30:34 devstack quobyte-client[81565]: Invalid parameters found, error: missing mount point. Apr 10 10:30:34 devstack quobyte-client[81565]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 10 10:30:34 devstack quobyte-client[81565]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 10 10:30:34 devstack cinder-volume[81564]: DEBUG oslo_concurrency.processutils [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] CMD "mount.quobyte" returned: 1 in 0.059s {{(pid=81564) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:30:34 devstack cinder-volume[81564]: DEBUG oslo_concurrency.lockutils [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81564) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:30:34 devstack cinder-volume[81564]: DEBUG oslo_concurrency.lockutils [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81564) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:30:34 devstack cinder-volume[81564]: DEBUG cinder.volume.drivers.quobyte [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81564) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:30:34 devstack cinder-volume[81564]: INFO cinder.volume.drivers.quobyte [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 ... Apr 10 10:30:34 devstack cinder-volume[81564]: DEBUG oslo_concurrency.processutils [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c -c /etc/quobyte/client-cinder.cfg {{(pid=81564) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:30:34 devstack sudo[81566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c -c /etc/quobyte/client-cinder.cfg Apr 10 10:30:34 devstack sudo[81566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:30:35 devstack sudo[81566]: pam_unix(sudo:session): session closed for user root Apr 10 10:30:35 devstack cinder-volume[81564]: DEBUG oslo_concurrency.processutils [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.526s {{(pid=81564) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:30:35 devstack cinder-volume[81564]: INFO cinder.volume.drivers.quobyte [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 succeeded Apr 10 10:30:35 devstack cinder-volume[81564]: DEBUG cinder.volume.drivers.quobyte [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81564) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:30:35 devstack cinder-volume[81564]: DEBUG oslo_concurrency.lockutils [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.534s {{(pid=81564) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:30:35 devstack cinder-volume[81564]: DEBUG oslo_concurrency.processutils [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81564) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:30:35 devstack sudo[81635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:30:35 devstack sudo[81635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:30:35 devstack sudo[81635]: pam_unix(sudo:session): session closed for user root Apr 10 10:30:35 devstack cinder-volume[81564]: DEBUG oslo_concurrency.processutils [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.391s {{(pid=81564) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:30:35 devstack cinder-volume[81564]: INFO cinder.volume.driver [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Driver hasn't implemented _init_vendor_properties() Apr 10 10:30:35 devstack cinder-volume[81564]: DEBUG cinder.volume.driver [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579803466797, 'free_capacity_gb': 1775.7579803466797, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81564) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 10 10:30:35 devstack cinder-volume[81564]: DEBUG oslo_db.sqlalchemy.engines [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81564) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:30:35 devstack cinder-volume[81564]: DEBUG dbcounter [-] [81564] Writer thread running {{(pid=81564) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 10:30:35 devstack cinder-volume[81564]: DEBUG cinder.db.sqlalchemy.api [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Building query based on filter {{(pid=81564) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 10 10:30:35 devstack cinder-volume[81564]: DEBUG cinder.image.image_utils [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81564) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 10 10:30:35 devstack cinder-volume[81564]: INFO cinder.keymgr.migration [None req-0f8bea89-e7bf-4817-9372-11654e368feb None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 10 10:30:35 devstack cinder-volume[81564]: DEBUG oslo_concurrency.lockutils [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81564) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:30:35 devstack cinder-volume[81564]: DEBUG oslo_concurrency.lockutils [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81564) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:30:35 devstack cinder-volume[81564]: DEBUG cinder.volume.drivers.quobyte [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81564) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:30:35 devstack cinder-volume[81564]: DEBUG cinder.volume.drivers.quobyte [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81564) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:30:35 devstack cinder-volume[81564]: DEBUG oslo_concurrency.lockutils [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81564) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:30:35 devstack cinder-volume[81564]: DEBUG oslo_concurrency.processutils [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81564) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:30:35 devstack sudo[81638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:30:35 devstack sudo[81638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:30:36 devstack sudo[81638]: pam_unix(sudo:session): session closed for user root Apr 10 10:30:36 devstack cinder-volume[81564]: DEBUG oslo_concurrency.processutils [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.447s {{(pid=81564) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:30:36 devstack cinder-volume[81564]: DEBUG cinder.manager [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Notifying Schedulers of capabilities ... {{(pid=81564) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:30:36 devstack cinder-volume[81564]: INFO cinder.volume.manager [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Driver initialization completed successfully. Apr 10 10:30:36 devstack cinder-volume[81564]: INFO cinder.manager [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Initiating service 3 cleanup Apr 10 10:30:36 devstack cinder-volume[81564]: INFO cinder.manager [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Service 3 cleanup completed. Apr 10 10:30:36 devstack cinder-volume[81564]: DEBUG cinder.service [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Creating RPC server for service cinder-volume {{(pid=81564) start /opt/stack/cinder/cinder/service.py:231}} Apr 10 10:30:36 devstack cinder-volume[81564]: DEBUG cinder.service [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81564) start /opt/stack/cinder/cinder/service.py:237}} Apr 10 10:30:36 devstack cinder-volume[81564]: INFO cinder.volume.manager [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 10 10:30:36 devstack cinder-volume[81564]: DEBUG oslo_concurrency.lockutils [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81564) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:30:36 devstack cinder-volume[81564]: DEBUG oslo_concurrency.lockutils [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81564) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:30:36 devstack cinder-volume[81564]: DEBUG cinder.volume.drivers.quobyte [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81564) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:30:36 devstack cinder-volume[81564]: DEBUG cinder.volume.drivers.quobyte [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81564) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:30:36 devstack cinder-volume[81564]: DEBUG oslo_concurrency.lockutils [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81564) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:30:36 devstack cinder-volume[81564]: DEBUG oslo_concurrency.processutils [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81564) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:30:36 devstack sudo[81643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:30:36 devstack sudo[81643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:30:36 devstack sudo[81643]: pam_unix(sudo:session): session closed for user root Apr 10 10:30:36 devstack cinder-volume[81564]: DEBUG oslo_concurrency.processutils [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.426s {{(pid=81564) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:30:36 devstack cinder-volume[81564]: INFO cinder.volume.manager [None req-ed24b66c-b63d-483c-b18a-d2db5aa808eb None None] Driver post RPC initialization completed successfully. Apr 10 10:30:39 devstack cinder-volume[81564]: DEBUG oslo_concurrency.lockutils [None req-3444e60c-3f63-4bc5-bd59-05b66a9e6b6d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81564) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:30:39 devstack cinder-volume[81564]: DEBUG oslo_concurrency.lockutils [None req-3444e60c-3f63-4bc5-bd59-05b66a9e6b6d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81564) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:30:39 devstack cinder-volume[81564]: DEBUG cinder.volume.drivers.quobyte [None req-3444e60c-3f63-4bc5-bd59-05b66a9e6b6d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81564) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:30:39 devstack cinder-volume[81564]: DEBUG cinder.volume.drivers.quobyte [None req-3444e60c-3f63-4bc5-bd59-05b66a9e6b6d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81564) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:30:39 devstack cinder-volume[81564]: DEBUG oslo_concurrency.lockutils [None req-3444e60c-3f63-4bc5-bd59-05b66a9e6b6d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81564) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:30:39 devstack cinder-volume[81564]: DEBUG oslo_concurrency.processutils [None req-3444e60c-3f63-4bc5-bd59-05b66a9e6b6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81564) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:30:39 devstack sudo[81708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:30:39 devstack sudo[81708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:30:40 devstack sudo[81708]: pam_unix(sudo:session): session closed for user root Apr 10 10:30:40 devstack cinder-volume[81564]: DEBUG oslo_concurrency.processutils [None req-3444e60c-3f63-4bc5-bd59-05b66a9e6b6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.388s {{(pid=81564) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:30:40 devstack cinder-volume[81564]: DEBUG cinder.manager [None req-3444e60c-3f63-4bc5-bd59-05b66a9e6b6d None None] Notifying Schedulers of capabilities ... {{(pid=81564) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:30:43 devstack cinder-volume[81446]: INFO oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] Caught SIGTERM, stopping children Apr 10 10:30:43 devstack cinder-volume[81446]: DEBUG oslo_concurrency.lockutils [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] Acquiring lock "singleton_lock" {{(pid=81446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 10:30:43 devstack cinder-volume[81446]: DEBUG oslo_concurrency.lockutils [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] Acquired lock "singleton_lock" {{(pid=81446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 10:30:43 devstack cinder-volume[81446]: DEBUG oslo_concurrency.lockutils [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] Releasing lock "singleton_lock" {{(pid=81446) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 10:30:43 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] Stop services. {{(pid=81446) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 10 10:30:43 devstack cinder-volume[81446]: DEBUG oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] Killing children. {{(pid=81446) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 10 10:30:43 devstack cinder-volume[81446]: INFO oslo_service.backend._eventlet.service [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] Waiting on 1 children to exit Apr 10 10:30:46 devstack cinder-volume[81564]: DEBUG dbcounter [-] [81564] Writing DB stats cinder:SELECT=5 {{(pid=81564) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:30:46 devstack cinder-volume[81564]: DEBUG dbcounter [-] [81564] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=81564) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:30:48 devstack cinder-volume[81564]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Apr 10 10:30:49 devstack cinder-volume[81822]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 10 10:30:49 devstack cinder-volume[81822]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 10:30:49 devstack cinder-volume[81822]: we strongly recommend against using it for new projects. Apr 10 10:30:49 devstack cinder-volume[81822]: If you are already using Eventlet, we recommend migrating to a different Apr 10 10:30:49 devstack cinder-volume[81822]: framework. For more detail see Apr 10 10:30:49 devstack cinder-volume[81822]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 10:30:49 devstack cinder-volume[81822]: import eventlet # noqa Apr 10 10:30:49 devstack cinder-volume[81564]: DEBUG oslo_concurrency.lockutils [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] Acquiring lock "singleton_lock" {{(pid=81564) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 10:30:49 devstack cinder-volume[81564]: DEBUG oslo_concurrency.lockutils [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] Acquired lock "singleton_lock" {{(pid=81564) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 10:30:49 devstack cinder-volume[81564]: DEBUG oslo_concurrency.lockutils [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] Releasing lock "singleton_lock" {{(pid=81564) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 10:30:49 devstack cinder-volume[81564]: WARNING amqp [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 10 10:30:49 devstack cinder-volume[81564]: WARNING amqp [None req-445856fc-5774-4fae-9498-8a35254d81e5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 10 10:30:50 devstack cinder-volume[81822]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81822) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 10:30:50 devstack cinder-volume[81822]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81822) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 10:30:50 devstack cinder-volume[81822]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81822) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 10:30:51 devstack cinder-volume[81822]: INFO dbcounter [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] Registered counter for database cinder Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_db.sqlalchemy.engines [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81822) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG dbcounter [-] [81822] Writer thread running {{(pid=81822) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 10:30:51 devstack cinder-volume[81822]: INFO cinder.rpc [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 10 10:30:51 devstack cinder-volume[81822]: INFO cinder.rpc [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_db.sqlalchemy.engines [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81822) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:30:51 devstack cinder-volume[81822]: INFO cinder.volume.manager [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] Determined volume DB was empty at startup. Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG cinder.volume.manager [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81822) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 10 10:30:51 devstack cinder-volume[81822]: WARNING stevedore.named [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 10 10:30:51 devstack cinder-volume[81822]: WARNING castellan.key_manager [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 10:30:51 devstack cinder-volume[81822]: WARNING cinder.keymgr.conf_key_mgr [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 10:30:51 devstack cinder-volume[81822]: INFO cinder.volume.manager [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_db.sqlalchemy.engines [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81822) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:30:51 devstack cinder-volume[81822]: INFO oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] Starting 1 workers Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] Started child 81938 {{(pid=81822) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] Full set of CONF: {{(pid=81822) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] ******************************************************************************** {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] Configuration options gathered from: {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 10 10:30:51 devstack cinder-volume[81938]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] ================================================================================ {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] allow_availability_zone_fallback = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] allow_compression_on_image_upload = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] allowed_direct_url_schemes = [] {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] api_rate_limit = True {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] auth_strategy = keystone {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_availability_zone = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_host = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_name = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_stats_polling_interval = 60 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backup_api_class = cinder.backup.api.API {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backup_name_template = backup-%s {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backup_use_same_host = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backup_use_temp_snapshot = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] chap_password = **** {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] chap_username = {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cinder_internal_tenant_project_id = a68862ab4b7a4fae88af82aba48e10fb {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cinder_internal_tenant_user_id = 2ad03d9ba0794c289abdc790fd6642eb {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cluster = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] compression_format = gzip {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] compute_api_class = cinder.compute.nova.API {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] config_dir = [] {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] config_source = [] {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] control_exchange = openstack {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] debug = True {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] default_availability_zone = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] default_group_type = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] default_volume_type = QuobyteHD {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] disk_geometry = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] driver_client_cert = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] driver_client_cert_key = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] driver_data_namespace = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] driver_ssl_cert_path = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] driver_ssl_cert_verify = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] driver_use_ssl = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] enable_new_services = True {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] enable_unsupported_driver = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] enabled_backends = ['QuobyteHD'] {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] enforce_multipath_for_image_xfer = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] filter_function = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] glance_api_insecure = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] glance_api_servers = ['http://192.168.122.66/image'] {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] glance_api_ssl_compression = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] glance_ca_certificates_file = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] glance_catalog_info = image:glance:publicURL {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] glance_certfile = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] glance_keyfile = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] glance_num_retries = 3 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] glance_request_timeout = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] goodness_function = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] graceful_shutdown_timeout = 5 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] group_api_class = cinder.group.api.API {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] host = devstack {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] image_compress_on_upload = True {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] image_conversion_address_space_limit = 1 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] image_conversion_cpu_limit = 60 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] image_conversion_disable = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] image_upload_use_cinder_backend = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] image_upload_use_internal_tenant = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] image_volume_cache_enabled = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] image_volume_cache_max_count = 0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] image_volume_cache_max_size_gb = 0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] init_host_max_objects_retrieval = 0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] instance_format = [instance: %(uuid)s] {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] iscsi_target_flags = {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] iscsi_write_cache = on {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] iser_helper = tgtadm {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] iser_ip_address = 192.168.122.66 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] iser_port = 3260 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] log_color = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] log_config_append = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81938) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] log_dir = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] log_file = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] log_options = True {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] log_rotate_interval = 1 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] log_rotate_interval_type = days {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] log_rotation_type = none {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] max_age = 0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] max_logfile_count = 30 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] max_logfile_size_mb = 200 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] max_over_subscription_ratio = 20.0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] message_reap_interval = 86400 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] message_ttl = 2592000 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] migration_create_volume_timeout_secs = 300 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] monkey_patch = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] monkey_patch_modules = [] {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] my_ip = 192.168.122.66 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] no_snapshot_gb_quota = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] num_iser_scan_tries = 3 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] num_shell_tries = 3 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] num_volume_device_scan_tries = 3 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] nvmeof_conn_info_version = 1 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] nvmet_ns_id = 10 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] nvmet_port_id = 1 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] osapi_max_limit = 1000 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] osapi_volume_ext_list = [] {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] osapi_volume_listen = 0.0.0.0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] osapi_volume_listen_port = 8776 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] osapi_volume_use_ssl = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] osapi_volume_workers = 2 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] per_volume_size_limit = -1 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] periodic_fuzzy_delay = 60 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] periodic_interval = 60 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] project_id_regex = [0-9a-f\-]+ {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] public_endpoint = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] publish_errors = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] quota_backup_gigabytes = 1000 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] quota_backups = 10 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] quota_gigabytes = 1000 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] quota_groups = 10 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] quota_snapshots = 10 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] quota_volumes = 10 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] rate_limit_burst = 0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] rate_limit_except_level = CRITICAL {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] rate_limit_interval = 0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] reinit_driver_count = 3 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] replication_device = **** {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] report_discard_supported = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] report_interval = 120 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] reservation_clean_interval = 86400 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] reservation_expire = 86400 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] reserved_image_namespaces = [] {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] reserved_percentage = 0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] rpc_response_timeout = 120 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] run_external_periodic_tasks = True {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] scst_target_driver = iscsi {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] scst_target_iqn_name = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] service_down_time = 720 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] shell_completion = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] snapshot_name_template = snapshot-%s {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] split_loggers = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] state_path = /opt/stack/data/cinder {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] storage_availability_zone = nova {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] storage_protocol = iSCSI {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] syslog_log_facility = LOG_USER {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] target_helper = lioadm {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] target_ip_address = 192.168.122.66 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] target_port = 3260 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] target_protocol = iscsi {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] target_secondary_ip_addresses = [] {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] trace_flags = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] transfer_api_class = cinder.transfer.api.API {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] transport_url = **** {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] until_refresh = 0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] use_chap_auth = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] use_default_quota_class = True {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] use_journal = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] use_json = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] use_multipath_for_image_xfer = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] use_stderr = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] use_syslog = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] verify_glance_signatures = enabled {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] volume_api_class = cinder.volume.api.API {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] volume_backend_name = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] volume_clear = zero {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] volume_clear_ionice = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] volume_clear_size = 0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] volume_copy_bps_limit = 0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] volume_dd_blocksize = 1M {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] volume_name_template = volume-%s {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] volume_service_inithost_offload = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] volume_usage_audit_period = month {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] zoning_mode = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_concurrency.disable_process_locking = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.admin_password = **** {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.admin_token = **** {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.admin_user = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.auth_admin_prefix = {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.auth_port = 35357 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.auth_protocol = https {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.auth_section = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.auth_type = password {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.auth_uri = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.auth_version = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.cache = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.certfile = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.delay_auth_decision = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.http_connect_timeout = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.identity_uri = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.include_service_catalog = True {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.insecure = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81938) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.interface = public {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.keyfile = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.quobyte [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.memcache_password = {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.quobyte [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Running cmd (subprocess): mount.quobyte {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.memcache_username = {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.region_name = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.service_token_roles_required = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.service_type = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.token_cache_time = 300 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.66/identity {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.backend = dogpile.cache.null {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.backend_argument = **** {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.backend_expiration_time = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.config_prefix = cache.oslo {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.debug_cache_backend = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.enable_retry_client = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.enable_socket_keepalive = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.enabled = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.enforce_fips_mode = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.expiration_time = 600 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.hashclient_retry_attempts = 2 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.memcache_dead_retry = 300 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.memcache_pool_maxsize = 10 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.memcache_sasl_enabled = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.password = **** {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.proxies = [] {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.redis_db = 0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.redis_sentinel_service_name = mymaster {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.redis_server = localhost:6379 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.retry_attempts = 2 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.retry_delay = 0.0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.socket_keepalive_count = 1 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.socket_keepalive_idle = 1 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.socket_keepalive_interval = 1 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.socket_timeout = 1.0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.tls_allowed_ciphers = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.tls_cafile = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.tls_certfile = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.tls_enabled = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.tls_keyfile = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cache.username = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] coordination.backend_url = **** {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] database.asyncio_connection = **** {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] database.asyncio_slave_connection = **** {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] database.backend = sqlalchemy {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] database.connection = **** {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] database.connection_debug = 0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] database.connection_parameters = {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] database.connection_recycle_time = 3600 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] database.connection_trace = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] database.db_inc_retry_interval = True {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] database.db_max_retries = 20 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] database.db_max_retry_interval = 10 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] database.db_retry_interval = 1 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] database.max_overflow = 50 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] database.max_pool_size = 5 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] database.max_retries = 10 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] database.mysql_wsrep_sync_wait = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] database.pool_timeout = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] database.retry_interval = 10 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] database.slave_connection = **** {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] database.sqlite_synchronous = True {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] database.synchronous_reader = True {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] database.use_db_reconnect = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] profiler.connection_string = messaging:// {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] profiler.enabled = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] profiler.es_doc_type = notification {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] profiler.es_scroll_size = 10000 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] profiler.es_scroll_time = 2m {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] profiler.filter_error_trace = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] profiler.hmac_keys = **** {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] profiler.sentinel_service_name = mymaster {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] profiler.socket_timeout = 0.1 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] profiler.trace_requests = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] profiler.trace_sqlalchemy = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] profiler_jaeger.process_tags = {} {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] profiler_jaeger.service_name_prefix = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] profiler_otlp.service_name_prefix = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_policy.enforce_new_defaults = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: WARNING oslo_config.cfg [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_policy.enforce_scope = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_policy.policy_default_rule = default {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_policy.policy_file = policy.yaml {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_policy.remote_timeout = 60.0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] privsep_osbrick.group = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] privsep_osbrick.helper_command = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] privsep_osbrick.user = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cinder_sys_admin.group = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cinder_sys_admin.helper_command = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] cinder_sys_admin.user = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] service_user.auth_section = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] service_user.auth_type = password {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] service_user.cafile = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] service_user.certfile = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] service_user.collect_timing = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] service_user.insecure = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] service_user.keyfile = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] service_user.send_service_user_token = True {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] service_user.split_loggers = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] service_user.timeout = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] glance.auth_section = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] glance.auth_type = password {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] glance.certfile = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] glance.collect_timing = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] glance.insecure = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] glance.keyfile = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] glance.region_name = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] glance.split_loggers = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] glance.timeout = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.backend_availability_zone = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.chap_password = **** {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.chap_username = {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.disk_geometry = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.driver_client_cert = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.driver_client_cert_key = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.driver_data_namespace = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.driver_use_ssl = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.enable_unsupported_driver = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.extra_capabilities = {} {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.filter_function = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.goodness_function = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack quobyte-client[81944]: Reading configuration file: /etc/quobyte/client.cfg Apr 10 10:30:51 devstack quobyte-client[81944]: Invalid parameters found, error: missing mount point. Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack quobyte-client[81944]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 10 10:30:51 devstack quobyte-client[81944]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.iscsi_target_flags = {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] CMD "mount.quobyte" returned: 1 in 0.056s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.iscsi_write_cache = on {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.iser_helper = tgtadm {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.iser_ip_address = 192.168.122.66 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.iser_port = 3260 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.nas_host = {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.nas_login = admin {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.nas_mount_options = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.nas_password = **** {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.nas_private_key = {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.nas_share_path = {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.nas_ssh_port = 22 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.num_shell_tries = 3 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.nvmet_port_id = 1 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.quobyte_client_cfg = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.quobyte_volume_url = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.replication_device = **** {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.report_discard_supported = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.reserved_percentage = 0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.scst_target_driver = iscsi {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.scst_target_iqn_name = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.storage_protocol = iSCSI {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.target_helper = tgtadm {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.target_ip_address = 192.168.122.66 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.target_port = 3260 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.target_protocol = iscsi {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.trace_flags = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.unique_fqdn_network = True {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.use_chap_auth = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.volume_backend_name = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.volume_clear = zero {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.volume_clear_ionice = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.volume_clear_size = 0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_reports.file_event_handler = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_reports.log_dir = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.backend_availability_zone = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.backend_host = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack sudo[81947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.chap_password = **** {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack sudo[81947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.chap_username = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.chiscsi_conf = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.disk_geometry = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.driver_client_cert = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.driver_client_cert_key = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.driver_data_namespace = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.driver_use_ssl = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.extra_capabilities = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.filter_function = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.goodness_function = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.iscsi_target_flags = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.iscsi_write_cache = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.iser_helper = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.iser_ip_address = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.iser_port = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.iser_target_prefix = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.nas_host = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.nas_login = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.nas_mount_options = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.nas_password = **** {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.nas_private_key = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.nas_share_path = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.nas_ssh_port = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.num_shell_tries = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.nvmet_ns_id = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.nvmet_port_id = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.replication_device = **** {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.report_discard_supported = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.reserved_percentage = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.scst_target_driver = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.storage_protocol = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.target_helper = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.target_ip_address = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.target_port = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.target_prefix = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.target_protocol = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.trace_flags = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.unique_fqdn_network = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.use_chap_auth = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.volume_clear = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.volume_clear_ionice = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.volume_clear_size = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] QuobyteHD.volumes_dir = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.ssl = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.ssl_version = {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_notifications.driver = [] {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_notifications.retry = -1 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] oslo_messaging_notifications.transport_url = **** {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] key_manager.fixed_key = **** {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] barbican.barbican_api_version = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] barbican.barbican_endpoint = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] barbican.barbican_endpoint_type = public {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] barbican.barbican_region_name = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] barbican.cafile = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] barbican.certfile = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] barbican.collect_timing = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] barbican.insecure = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] barbican.keyfile = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] barbican.number_of_retries = 60 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] barbican.retry_delay = 1 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] barbican.send_service_user_token = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] barbican.split_loggers = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] barbican.timeout = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] barbican.verify_ssl = True {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] barbican.verify_ssl_path = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] barbican_service_user.auth_section = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] barbican_service_user.auth_type = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] barbican_service_user.cafile = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] barbican_service_user.certfile = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] barbican_service_user.collect_timing = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] barbican_service_user.insecure = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] barbican_service_user.keyfile = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] barbican_service_user.split_loggers = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] barbican_service_user.timeout = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] vault.approle_role_id = **** {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] vault.approle_secret_id = **** {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] vault.kv_mountpoint = secret {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] vault.kv_path = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] vault.kv_version = 2 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] vault.namespace = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] vault.root_token_id = **** {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] vault.ssl_ca_crt_file = None {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] vault.timeout = 60.0 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] vault.use_ssl = False {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:30:51 devstack cinder-volume[81822]: DEBUG oslo_service.backend._eventlet.service [None req-b93a60bf-2553-4053-bd87-2b3ebfe3228a None None] ******************************************************************************** {{(pid=81822) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 10 10:30:52 devstack sudo[81947]: pam_unix(sudo:session): session closed for user root Apr 10 10:30:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.409s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:30:52 devstack cinder-volume[81938]: INFO cinder.volume.driver [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Driver hasn't implemented _init_vendor_properties() Apr 10 10:30:52 devstack cinder-volume[81938]: DEBUG cinder.volume.driver [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579803466797, 'free_capacity_gb': 1775.7579803466797, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81938) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 10 10:30:52 devstack cinder-volume[81938]: DEBUG oslo_db.sqlalchemy.engines [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81938) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:30:52 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writer thread running {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 10:30:52 devstack cinder-volume[81938]: DEBUG cinder.db.sqlalchemy.api [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Building query based on filter {{(pid=81938) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 10 10:30:52 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81938) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 10 10:30:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:30:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:30:52 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:30:52 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:30:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:30:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:30:52 devstack sudo[81972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:30:52 devstack sudo[81972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:30:52 devstack cinder-volume[81938]: INFO cinder.keymgr.migration [None req-6b4b93ae-98d1-48f9-9033-c70a9eea7e01 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 10 10:30:52 devstack sudo[81972]: pam_unix(sudo:session): session closed for user root Apr 10 10:30:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.419s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:30:52 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:30:52 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Driver initialization completed successfully. Apr 10 10:30:52 devstack cinder-volume[81938]: INFO cinder.manager [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Initiating service 3 cleanup Apr 10 10:30:52 devstack cinder-volume[81938]: INFO cinder.manager [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Service 3 cleanup completed. Apr 10 10:30:52 devstack cinder-volume[81938]: DEBUG cinder.service [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Creating RPC server for service cinder-volume {{(pid=81938) start /opt/stack/cinder/cinder/service.py:231}} Apr 10 10:30:52 devstack cinder-volume[81938]: DEBUG cinder.service [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81938) start /opt/stack/cinder/cinder/service.py:237}} Apr 10 10:30:52 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 10 10:30:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:30:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:30:52 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:30:52 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:30:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:30:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:30:52 devstack sudo[82019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:30:52 devstack sudo[82019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:30:53 devstack sudo[82019]: pam_unix(sudo:session): session closed for user root Apr 10 10:30:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.406s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:30:53 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-1ca51403-dfd7-4665-a993-033ede7b4254 None None] Driver post RPC initialization completed successfully. Apr 10 10:31:01 devstack cinder-volume[81822]: DEBUG dbcounter [-] [81822] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81822) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:31:02 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:31:03 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writing DB stats cinder:SELECT=3 {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:31:58 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:31:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] Flow 'volume_create_manager' (ee733c9d-7689-476e-b1d3-e7d9668f845d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:31:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d13f2297-0690-40e3-98e2-4db90b898baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:31:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d13f2297-0690-40e3-98e2-4db90b898baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1641408055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba1c1686-3555-4aa6-8039-7f957ada278a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e562a9a36ad46ad90cffbe45d0ec22a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:31:58Z,use_quota=True,user_id='a696fa1d64924572a0fd733a7518463c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:31:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f107248-7322-47d5-8d8f-efca07f8de63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:31:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f107248-7322-47d5-8d8f-efca07f8de63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:31:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0511fc34-949a-45fb-81f1-4acae372fe46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:31:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0511fc34-949a-45fb-81f1-4acae372fe46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba1c1686-3555-4aa6-8039-7f957ada278a', 'volume_name': 'volume-ba1c1686-3555-4aa6-8039-7f957ada278a', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:31:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a653480-babb-4a98-869f-499d3d6652b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:31:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a653480-babb-4a98-869f-499d3d6652b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:31:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5730b8c-940c-4746-a826-c45508fa19bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:31:58 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] Volume ba1c1686-3555-4aa6-8039-7f957ada278a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba1c1686-3555-4aa6-8039-7f957ada278a', 'volume_size': 1} Apr 10 10:31:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:31:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:31:58 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1641408055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba1c1686-3555-4aa6-8039-7f957ada278a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e562a9a36ad46ad90cffbe45d0ec22a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:31:58Z,use_quota=True,user_id='a696fa1d64924572a0fd733a7518463c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:31:58 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] Creating volume ba1c1686-3555-4aa6-8039-7f957ada278a {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:31:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:31:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:31:58 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:31:58 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:31:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:31:58 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:31:58 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:31:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ba1c1686-3555-4aa6-8039-7f957ada278a 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:58 devstack sudo[82428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ba1c1686-3555-4aa6-8039-7f957ada278a 1073741824 Apr 10 10:31:58 devstack sudo[82428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:00 devstack sudo[82428]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ba1c1686-3555-4aa6-8039-7f957ada278a 1073741824" returned: 0 in 1.914s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ba1c1686-3555-4aa6-8039-7f957ada278a {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:00 devstack sudo[82749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ba1c1686-3555-4aa6-8039-7f957ada278a Apr 10 10:32:00 devstack sudo[82749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:01 devstack sudo[82749]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ba1c1686-3555-4aa6-8039-7f957ada278a" returned: 0 in 1.232s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:01 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] <== create_volume: return (3281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:32:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.284s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5730b8c-940c-4746-a826-c45508fa19bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba1c1686-3555-4aa6-8039-7f957ada278a', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8dafe58-1083-4049-b755-b0ecac09f356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:01 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] Volume volume-ba1c1686-3555-4aa6-8039-7f957ada278a (ba1c1686-3555-4aa6-8039-7f957ada278a): created successfully Apr 10 10:32:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8dafe58-1083-4049-b755-b0ecac09f356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] Flow 'volume_create_manager' (ee733c9d-7689-476e-b1d3-e7d9668f845d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:32:01 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-c518627c-4acb-4d55-b769-475dce2af151 tempest-VolumesAdminNegativeTest-879200045 None] Created volume successfully. Apr 10 10:32:03 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-3893abe2-8d02-4735-9aa6-7bb2afe2d623 tempest-VolumesAdminNegativeTest-879200045 None] Acquiring lock "cinder-ba1c1686-3555-4aa6-8039-7f957ada278a-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:03 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-3893abe2-8d02-4735-9aa6-7bb2afe2d623 tempest-VolumesAdminNegativeTest-879200045 None] Lock "cinder-ba1c1686-3555-4aa6-8039-7f957ada278a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:03 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-3893abe2-8d02-4735-9aa6-7bb2afe2d623 tempest-VolumesAdminNegativeTest-879200045 None] Acquiring lock "cinder-quobyte-ba1c1686-3555-4aa6-8039-7f957ada278a" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:03 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-3893abe2-8d02-4735-9aa6-7bb2afe2d623 tempest-VolumesAdminNegativeTest-879200045 None] Lock "cinder-quobyte-ba1c1686-3555-4aa6-8039-7f957ada278a" acquired by "delete_volume" :: waited 0.028s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:04 devstack cinder-volume[81938]: INFO oslo.privsep.daemon [None req-3893abe2-8d02-4735-9aa6-7bb2afe2d623 tempest-VolumesAdminNegativeTest-879200045 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpa0tqo0_4/privsep.sock'] Apr 10 10:32:04 devstack sudo[82753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpa0tqo0_4/privsep.sock Apr 10 10:32:04 devstack sudo[82753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:04 devstack cinder-volume[81938]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 10 10:32:04 devstack cinder-volume[81938]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 10:32:04 devstack cinder-volume[81938]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 10 10:32:04 devstack cinder-volume[81938]: WARNING oslo.privsep.daemon [-] privsep log: Apr 10 10:32:04 devstack cinder-volume[81938]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 10 10:32:04 devstack cinder-volume[81938]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 10 10:32:04 devstack cinder-volume[81938]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 10:32:04 devstack cinder-volume[81938]: WARNING oslo.privsep.daemon [-] privsep log: Apr 10 10:32:04 devstack cinder-volume[81938]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 10 10:32:05 devstack cinder-volume[81938]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 10 10:32:05 devstack cinder-volume[81938]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 10:32:05 devstack cinder-volume[81938]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 10 10:32:05 devstack cinder-volume[81938]: WARNING oslo.privsep.daemon [-] privsep log: Apr 10 10:32:05 devstack cinder-volume[81938]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 10 10:32:05 devstack cinder-volume[81938]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 10 10:32:05 devstack cinder-volume[81938]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 10:32:05 devstack cinder-volume[81938]: WARNING oslo.privsep.daemon [-] privsep log: Apr 10 10:32:05 devstack cinder-volume[81938]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 10 10:32:06 devstack sudo[82753]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:06 devstack cinder-volume[81938]: INFO oslo.privsep.daemon [None req-3893abe2-8d02-4735-9aa6-7bb2afe2d623 tempest-VolumesAdminNegativeTest-879200045 None] Spawned new privsep daemon via rootwrap Apr 10 10:32:06 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [None req-3893abe2-8d02-4735-9aa6-7bb2afe2d623 tempest-VolumesAdminNegativeTest-879200045 None] Accepted privsep connection to /tmp/tmpa0tqo0_4/privsep.sock {{(pid=81938) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 10 10:32:06 devstack cinder-volume[81938]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 10 10:32:06 devstack cinder-volume[81938]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 10 10:32:06 devstack cinder-volume[81938]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 10 10:32:06 devstack cinder-volume[81938]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82756 Apr 10 10:32:06 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a3b879-cda6-471d-8349-b2bc3cd36e98]: (2,) {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:06 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df716f0-2563-48ef-a454-876ef13bbecb]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3893abe2-8d02-4735-9aa6-7bb2afe2d623 tempest-VolumesAdminNegativeTest-879200045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ba1c1686-3555-4aa6-8039-7f957ada278a {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:06 devstack sudo[82762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ba1c1686-3555-4aa6-8039-7f957ada278a Apr 10 10:32:06 devstack sudo[82762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:08 devstack sudo[82762]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3893abe2-8d02-4735-9aa6-7bb2afe2d623 tempest-VolumesAdminNegativeTest-879200045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ba1c1686-3555-4aa6-8039-7f957ada278a" returned: 0 in 1.751s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3893abe2-8d02-4735-9aa6-7bb2afe2d623 tempest-VolumesAdminNegativeTest-879200045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ba1c1686-3555-4aa6-8039-7f957ada278a {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:08 devstack sudo[82779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ba1c1686-3555-4aa6-8039-7f957ada278a Apr 10 10:32:08 devstack sudo[82779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:09 devstack sudo[82779]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3893abe2-8d02-4735-9aa6-7bb2afe2d623 tempest-VolumesAdminNegativeTest-879200045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ba1c1686-3555-4aa6-8039-7f957ada278a" returned: 0 in 1.254s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:09 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-3893abe2-8d02-4735-9aa6-7bb2afe2d623 tempest-VolumesAdminNegativeTest-879200045 None] Lock "cinder-quobyte-ba1c1686-3555-4aa6-8039-7f957ada278a" released by "delete_volume" :: held 5.593s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:09 devstack cinder-volume[81938]: WARNING cinder.quota [None req-3893abe2-8d02-4735-9aa6-7bb2afe2d623 tempest-VolumesAdminNegativeTest-879200045 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:32:09 devstack cinder-volume[81938]: WARNING cinder.quota [None req-3893abe2-8d02-4735-9aa6-7bb2afe2d623 tempest-VolumesAdminNegativeTest-879200045 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:32:09 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-3893abe2-8d02-4735-9aa6-7bb2afe2d623 tempest-VolumesAdminNegativeTest-879200045 None] Created reservations ['66a73d30-de50-43f4-9f5e-7e9a83ff4199', 'a3d29064-5def-4565-91c9-1b776bd8f032', 'f25bdf09-70e5-4e95-bf2e-1664aa524dd6', 'cbf5ebd1-f46d-417e-ae54-49f8ac857065'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:32:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3893abe2-8d02-4735-9aa6-7bb2afe2d623 tempest-VolumesAdminNegativeTest-879200045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3893abe2-8d02-4735-9aa6-7bb2afe2d623 tempest-VolumesAdminNegativeTest-879200045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:09 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3893abe2-8d02-4735-9aa6-7bb2afe2d623 tempest-VolumesAdminNegativeTest-879200045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:32:09 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3893abe2-8d02-4735-9aa6-7bb2afe2d623 tempest-VolumesAdminNegativeTest-879200045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:32:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3893abe2-8d02-4735-9aa6-7bb2afe2d623 tempest-VolumesAdminNegativeTest-879200045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3893abe2-8d02-4735-9aa6-7bb2afe2d623 tempest-VolumesAdminNegativeTest-879200045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:10 devstack sudo[82784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:32:10 devstack sudo[82784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:10 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:32:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Flow 'volume_create_manager' (15ad1f60-b12e-4d84-a99c-a65e362e5daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:32:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1e86c2d-d531-41fa-b542-6cf924834a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1e86c2d-d531-41fa-b542-6cf924834a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:32:10Z,deleted=False,deleted_at=None,display_description='',display_name='12c9ca54-7edc-4961-a924-16f782ed40f6-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b234d731de441beb064c25ea9a7303e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:10Z,use_quota=True,user_id='f187b22beb5143ed8c15e210b80f4a1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c79962-023d-4ffb-ae89-acb986f520c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c79962-023d-4ffb-ae89-acb986f520c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24e32e4-4988-4e0d-9854-6e9424397758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24e32e4-4988-4e0d-9854-6e9424397758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5', 'volume_name': 'volume-21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d549c3-332e-4d56-9785-e282d95f694b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d549c3-332e-4d56-9785-e282d95f694b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e49d0719-5f8f-408e-8037-129882d86e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:10 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Volume 21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5', 'volume_size': 1} Apr 10 10:32:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:10 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:32:10Z,deleted=False,deleted_at=None,display_description='',display_name='12c9ca54-7edc-4961-a924-16f782ed40f6-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b234d731de441beb064c25ea9a7303e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:10Z,use_quota=True,user_id='f187b22beb5143ed8c15e210b80f4a1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:32:10 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Creating volume 21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:32:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:10 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:32:10 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:32:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:10 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:32:10 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:32:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:10 devstack sudo[82786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5 1073741824 Apr 10 10:32:10 devstack sudo[82786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:11 devstack sudo[82784]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3893abe2-8d02-4735-9aa6-7bb2afe2d623 tempest-VolumesAdminNegativeTest-879200045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 1.375s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:11 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-3893abe2-8d02-4735-9aa6-7bb2afe2d623 tempest-VolumesAdminNegativeTest-879200045 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:32:11 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-3893abe2-8d02-4735-9aa6-7bb2afe2d623 tempest-VolumesAdminNegativeTest-879200045 None] Deleted volume successfully. Apr 10 10:32:11 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-3893abe2-8d02-4735-9aa6-7bb2afe2d623 tempest-VolumesAdminNegativeTest-879200045 None] Lock "cinder-ba1c1686-3555-4aa6-8039-7f957ada278a-delete_volume" released by "delete_volume" :: held 7.595s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:12 devstack sudo[82786]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5 1073741824" returned: 0 in 1.596s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:12 devstack sudo[82794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5 Apr 10 10:32:12 devstack sudo[82794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:13 devstack sudo[82794]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5" returned: 0 in 0.998s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:13 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] <== create_volume: return (2682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:32:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.688s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:13 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e49d0719-5f8f-408e-8037-129882d86e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:13 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0045d893-37d7-4670-ae75-f0a1349d72d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:13 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Volume volume-21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5 (21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5): created successfully Apr 10 10:32:13 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0045d893-37d7-4670-ae75-f0a1349d72d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:13 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Flow 'volume_create_manager' (15ad1f60-b12e-4d84-a99c-a65e362e5daf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:32:13 devstack cinder-volume[81938]: INFO cinder.volume.manager [req-151c139b-327b-4571-99bc-776b09c847f9 req-e5eaca14-578d-4d99-9de0-17efe5fde7cb tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Created volume successfully. Apr 10 10:32:19 devstack cinder-volume[81938]: WARNING py.warnings [req-151c139b-327b-4571-99bc-776b09c847f9 req-327e1ea3-7414-4e6c-8838-92a80e61a3b4 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Apr 10 10:32:19 devstack cinder-volume[81938]: .first() Apr 10 10:32:19 devstack cinder-volume[81938]: Apr 10 10:32:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-151c139b-327b-4571-99bc-776b09c847f9 req-327e1ea3-7414-4e6c-8838-92a80e61a3b4 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-151c139b-327b-4571-99bc-776b09c847f9 req-327e1ea3-7414-4e6c-8838-92a80e61a3b4 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:19 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fd5e85-a3c7-43e2-aa46-a54a058f507d]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-151c139b-327b-4571-99bc-776b09c847f9 req-327e1ea3-7414-4e6c-8838-92a80e61a3b4 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:19 devstack sudo[82884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5 Apr 10 10:32:19 devstack sudo[82884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:20 devstack sudo[82884]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-151c139b-327b-4571-99bc-776b09c847f9 req-327e1ea3-7414-4e6c-8838-92a80e61a3b4 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5" returned: 0 in 0.818s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-151c139b-327b-4571-99bc-776b09c847f9 req-327e1ea3-7414-4e6c-8838-92a80e61a3b4 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.847s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-151c139b-327b-4571-99bc-776b09c847f9 req-327e1ea3-7414-4e6c-8838-92a80e61a3b4 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4', 'name': 'volume-21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2bb2fd2a-3cf4-4803-a7e1-d2a2ab9edb08', 'enforce_multipath': True} {{(pid=81938) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 10 10:32:20 devstack cinder-volume[81938]: INFO cinder.volume.manager [req-151c139b-327b-4571-99bc-776b09c847f9 req-327e1ea3-7414-4e6c-8838-92a80e61a3b4 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] attachment_update completed successfully. Apr 10 10:32:30 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writing DB stats cinder:SELECT=15,cinder:UPDATE=17,cinder:INSERT=6,cinder:DELETE=2 {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:32:30 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writing DB stats cinder:SELECT=14,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:32:38 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:32:38 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] Flow 'volume_create_manager' (b0339d21-c63f-4a41-b608-7b900ddf0ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:32:38 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f70bee-9f6c-4e5f-b218-84be6ac92139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:39 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f70bee-9f6c-4e5f-b218-84be6ac92139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1106602555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c229e9c-2acf-4b16-a43d-ff30d2ccc150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3f069971f34810973212d2fcd63a91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:39Z,use_quota=True,user_id='7b1f99cab1ae471b9449f315112bf130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:39 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a149f420-85f9-4212-853a-b4ef14e2180b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:39 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a149f420-85f9-4212-853a-b4ef14e2180b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:39 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc73dee-2e0f-4c7e-b498-fe0218bde231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:39 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc73dee-2e0f-4c7e-b498-fe0218bde231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c229e9c-2acf-4b16-a43d-ff30d2ccc150', 'volume_name': 'volume-5c229e9c-2acf-4b16-a43d-ff30d2ccc150', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:39 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40959f15-f08d-4177-adba-a98a11ce76a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:39 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40959f15-f08d-4177-adba-a98a11ce76a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:39 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6054e18e-ad8f-453e-8511-ed6ecb839570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:39 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] Volume 5c229e9c-2acf-4b16-a43d-ff30d2ccc150: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c229e9c-2acf-4b16-a43d-ff30d2ccc150', 'volume_size': 1} Apr 10 10:32:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:39 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1106602555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c229e9c-2acf-4b16-a43d-ff30d2ccc150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3f069971f34810973212d2fcd63a91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:39Z,use_quota=True,user_id='7b1f99cab1ae471b9449f315112bf130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:32:39 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] Creating volume 5c229e9c-2acf-4b16-a43d-ff30d2ccc150 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:32:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:39 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:32:39 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:32:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:39 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:32:39 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:32:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5c229e9c-2acf-4b16-a43d-ff30d2ccc150 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:39 devstack sudo[83482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5c229e9c-2acf-4b16-a43d-ff30d2ccc150 1073741824 Apr 10 10:32:39 devstack sudo[83482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:41 devstack sudo[83482]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5c229e9c-2acf-4b16-a43d-ff30d2ccc150 1073741824" returned: 0 in 1.852s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5c229e9c-2acf-4b16-a43d-ff30d2ccc150 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:41 devstack sudo[83505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5c229e9c-2acf-4b16-a43d-ff30d2ccc150 Apr 10 10:32:41 devstack sudo[83505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:42 devstack sudo[83505]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5c229e9c-2acf-4b16-a43d-ff30d2ccc150" returned: 0 in 0.970s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:42 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] <== create_volume: return (2920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:32:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.926s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:42 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6054e18e-ad8f-453e-8511-ed6ecb839570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c229e9c-2acf-4b16-a43d-ff30d2ccc150', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:42 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92accf3-1268-4193-8c46-da2e795f3aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:42 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] Volume volume-5c229e9c-2acf-4b16-a43d-ff30d2ccc150 (5c229e9c-2acf-4b16-a43d-ff30d2ccc150): created successfully Apr 10 10:32:42 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92accf3-1268-4193-8c46-da2e795f3aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:42 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] Flow 'volume_create_manager' (b0339d21-c63f-4a41-b608-7b900ddf0ed3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:32:42 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-3fdbed59-b763-44cd-acf4-1197b099d588 tempest-ServersNegativeTestJSON-1196717886 None] Created volume successfully. Apr 10 10:32:46 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:32:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] Flow 'volume_create_manager' (2bde8ea0-c27d-45e0-8467-c4193430db09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:32:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7182d316-e8d6-4511-96c3-858ed6af8c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7182d316-e8d6-4511-96c3-858ed6af8c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-882485517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb0cdd28-36b9-47fd-a7de-223455345e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3f069971f34810973212d2fcd63a91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:46Z,use_quota=True,user_id='7b1f99cab1ae471b9449f315112bf130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (068012a5-ad41-4f77-8586-773ad1a77b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (068012a5-ad41-4f77-8586-773ad1a77b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34bd0662-b930-4129-9f18-ce84abb31479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34bd0662-b930-4129-9f18-ce84abb31479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb0cdd28-36b9-47fd-a7de-223455345e66', 'volume_name': 'volume-cb0cdd28-36b9-47fd-a7de-223455345e66', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1809afc0-7c3a-4332-a7a4-ed8dfe021e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1809afc0-7c3a-4332-a7a4-ed8dfe021e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83791754-d8d8-4238-aa1e-c0b904a32f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:46 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] Volume cb0cdd28-36b9-47fd-a7de-223455345e66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb0cdd28-36b9-47fd-a7de-223455345e66', 'volume_size': 1} Apr 10 10:32:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:46 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-882485517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb0cdd28-36b9-47fd-a7de-223455345e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3f069971f34810973212d2fcd63a91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:46Z,use_quota=True,user_id='7b1f99cab1ae471b9449f315112bf130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:32:46 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] Creating volume cb0cdd28-36b9-47fd-a7de-223455345e66 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:32:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:46 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:32:46 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:32:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:46 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:32:46 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:32:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cb0cdd28-36b9-47fd-a7de-223455345e66 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:46 devstack sudo[83582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cb0cdd28-36b9-47fd-a7de-223455345e66 1073741824 Apr 10 10:32:46 devstack sudo[83582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:47 devstack sudo[83582]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cb0cdd28-36b9-47fd-a7de-223455345e66 1073741824" returned: 0 in 1.059s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cb0cdd28-36b9-47fd-a7de-223455345e66 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:47 devstack sudo[83595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cb0cdd28-36b9-47fd-a7de-223455345e66 Apr 10 10:32:47 devstack sudo[83595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:48 devstack cinder-volume[81938]: DEBUG oslo_service.periodic_task [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81938) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:32:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:32:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:32:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:48 devstack sudo[83598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:32:48 devstack sudo[83598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:48 devstack sudo[83595]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cb0cdd28-36b9-47fd-a7de-223455345e66" returned: 0 in 0.813s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] <== create_volume: return (1935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:32:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.942s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:48 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83791754-d8d8-4238-aa1e-c0b904a32f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb0cdd28-36b9-47fd-a7de-223455345e66', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:48 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a8d65e8-57c4-4364-831b-46ad7315f08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:48 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] Volume volume-cb0cdd28-36b9-47fd-a7de-223455345e66 (cb0cdd28-36b9-47fd-a7de-223455345e66): created successfully Apr 10 10:32:48 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a8d65e8-57c4-4364-831b-46ad7315f08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:48 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] Flow 'volume_create_manager' (2bde8ea0-c27d-45e0-8467-c4193430db09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:32:48 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-174ab416-8d53-4f6d-ba2b-6d75ec28ce7c tempest-ServersNegativeTestJSON-1196717886 None] Created volume successfully. Apr 10 10:32:48 devstack sudo[83598]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.850s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:48 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:32:49 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-643baad4-f265-4aaf-a738-3d9018eecb6c tempest-ServersNegativeTestJSON-1196717886 None] Acquiring lock "cinder-cb0cdd28-36b9-47fd-a7de-223455345e66-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:49 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-643baad4-f265-4aaf-a738-3d9018eecb6c tempest-ServersNegativeTestJSON-1196717886 None] Lock "cinder-cb0cdd28-36b9-47fd-a7de-223455345e66-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:50 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-643baad4-f265-4aaf-a738-3d9018eecb6c tempest-ServersNegativeTestJSON-1196717886 None] Acquiring lock "cinder-quobyte-cb0cdd28-36b9-47fd-a7de-223455345e66" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:50 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-643baad4-f265-4aaf-a738-3d9018eecb6c tempest-ServersNegativeTestJSON-1196717886 None] Lock "cinder-quobyte-cb0cdd28-36b9-47fd-a7de-223455345e66" acquired by "delete_volume" :: waited 0.038s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:50 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b8847f-a037-476c-91eb-2362bea3bac3]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-643baad4-f265-4aaf-a738-3d9018eecb6c tempest-ServersNegativeTestJSON-1196717886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cb0cdd28-36b9-47fd-a7de-223455345e66 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:50 devstack sudo[83609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cb0cdd28-36b9-47fd-a7de-223455345e66 Apr 10 10:32:50 devstack sudo[83609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:51 devstack sudo[83609]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-643baad4-f265-4aaf-a738-3d9018eecb6c tempest-ServersNegativeTestJSON-1196717886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cb0cdd28-36b9-47fd-a7de-223455345e66" returned: 0 in 1.583s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-643baad4-f265-4aaf-a738-3d9018eecb6c tempest-ServersNegativeTestJSON-1196717886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cb0cdd28-36b9-47fd-a7de-223455345e66 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:51 devstack sudo[83641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cb0cdd28-36b9-47fd-a7de-223455345e66 Apr 10 10:32:51 devstack sudo[83641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:53 devstack sudo[83641]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-643baad4-f265-4aaf-a738-3d9018eecb6c tempest-ServersNegativeTestJSON-1196717886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cb0cdd28-36b9-47fd-a7de-223455345e66" returned: 0 in 1.234s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:53 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-643baad4-f265-4aaf-a738-3d9018eecb6c tempest-ServersNegativeTestJSON-1196717886 None] Lock "cinder-quobyte-cb0cdd28-36b9-47fd-a7de-223455345e66" released by "delete_volume" :: held 2.910s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:53 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-643baad4-f265-4aaf-a738-3d9018eecb6c tempest-ServersNegativeTestJSON-1196717886 None] Created reservations ['ec34d5fc-16ad-4dea-88de-3ef2defde005', 'cf2ac22a-9ae1-42c6-91ec-2bda8b416486', 'ec848364-7a93-4257-a4a3-686b01e3b67e', '8adaa4e2-727b-414e-8862-90b273104547'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:32:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-643baad4-f265-4aaf-a738-3d9018eecb6c tempest-ServersNegativeTestJSON-1196717886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-643baad4-f265-4aaf-a738-3d9018eecb6c tempest-ServersNegativeTestJSON-1196717886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.050s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:53 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-643baad4-f265-4aaf-a738-3d9018eecb6c tempest-ServersNegativeTestJSON-1196717886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:32:53 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-643baad4-f265-4aaf-a738-3d9018eecb6c tempest-ServersNegativeTestJSON-1196717886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:32:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-643baad4-f265-4aaf-a738-3d9018eecb6c tempest-ServersNegativeTestJSON-1196717886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-643baad4-f265-4aaf-a738-3d9018eecb6c tempest-ServersNegativeTestJSON-1196717886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:53 devstack sudo[83691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:32:53 devstack sudo[83691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:53 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-df669e07-1fa2-45d1-aa1c-a0573db9ff72 tempest-ServersNegativeTestJSON-1196717886 None] Acquiring lock "cinder-5c229e9c-2acf-4b16-a43d-ff30d2ccc150-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:54 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-df669e07-1fa2-45d1-aa1c-a0573db9ff72 tempest-ServersNegativeTestJSON-1196717886 None] Lock "cinder-5c229e9c-2acf-4b16-a43d-ff30d2ccc150-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:54 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-df669e07-1fa2-45d1-aa1c-a0573db9ff72 tempest-ServersNegativeTestJSON-1196717886 None] Acquiring lock "cinder-quobyte-5c229e9c-2acf-4b16-a43d-ff30d2ccc150" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:54 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-df669e07-1fa2-45d1-aa1c-a0573db9ff72 tempest-ServersNegativeTestJSON-1196717886 None] Lock "cinder-quobyte-5c229e9c-2acf-4b16-a43d-ff30d2ccc150" acquired by "delete_volume" :: waited 0.019s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:54 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde47410-3330-43d7-aeae-c510db4774b4]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-df669e07-1fa2-45d1-aa1c-a0573db9ff72 tempest-ServersNegativeTestJSON-1196717886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5c229e9c-2acf-4b16-a43d-ff30d2ccc150 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:54 devstack sudo[83702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5c229e9c-2acf-4b16-a43d-ff30d2ccc150 Apr 10 10:32:54 devstack sudo[83702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:55 devstack sudo[83691]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-643baad4-f265-4aaf-a738-3d9018eecb6c tempest-ServersNegativeTestJSON-1196717886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 1.420s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:55 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-643baad4-f265-4aaf-a738-3d9018eecb6c tempest-ServersNegativeTestJSON-1196717886 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:32:55 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-643baad4-f265-4aaf-a738-3d9018eecb6c tempest-ServersNegativeTestJSON-1196717886 None] Deleted volume successfully. Apr 10 10:32:55 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-643baad4-f265-4aaf-a738-3d9018eecb6c tempest-ServersNegativeTestJSON-1196717886 None] Lock "cinder-cb0cdd28-36b9-47fd-a7de-223455345e66-delete_volume" released by "delete_volume" :: held 5.073s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:55 devstack sudo[83702]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-df669e07-1fa2-45d1-aa1c-a0573db9ff72 tempest-ServersNegativeTestJSON-1196717886 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5c229e9c-2acf-4b16-a43d-ff30d2ccc150" returned: 0 in 1.322s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-df669e07-1fa2-45d1-aa1c-a0573db9ff72 tempest-ServersNegativeTestJSON-1196717886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5c229e9c-2acf-4b16-a43d-ff30d2ccc150 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:55 devstack sudo[83753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5c229e9c-2acf-4b16-a43d-ff30d2ccc150 Apr 10 10:32:55 devstack sudo[83753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:57 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:32:57 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] Flow 'volume_create_manager' (6fedc84a-ebd5-4947-96dd-ab27c6f7b62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:32:57 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07edb8a9-9436-454e-b28d-9eb119a9f7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:57 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07edb8a9-9436-454e-b28d-9eb119a9f7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1451156795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8eab4ea-f0c4-4a2c-989a-5b150705d041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1585ea2b41624967a72d7d1b848e5162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:57Z,use_quota=True,user_id='c11b867cb6874c4cbd2eddcbd79ebbc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:57 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (978b5206-0d93-484f-ba57-307c3989a3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:57 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (978b5206-0d93-484f-ba57-307c3989a3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:57 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c34e8ec-dcc3-4040-a994-ef94f8a673c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:57 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c34e8ec-dcc3-4040-a994-ef94f8a673c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8eab4ea-f0c4-4a2c-989a-5b150705d041', 'volume_name': 'volume-a8eab4ea-f0c4-4a2c-989a-5b150705d041', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:57 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (738d0613-8e9c-4e2f-9388-1bcb833984b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:57 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (738d0613-8e9c-4e2f-9388-1bcb833984b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:57 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fdb41c7-c064-451a-bc73-708da1f8e261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:57 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] Volume a8eab4ea-f0c4-4a2c-989a-5b150705d041: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8eab4ea-f0c4-4a2c-989a-5b150705d041', 'volume_size': 1} Apr 10 10:32:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:57 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1451156795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8eab4ea-f0c4-4a2c-989a-5b150705d041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1585ea2b41624967a72d7d1b848e5162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:57Z,use_quota=True,user_id='c11b867cb6874c4cbd2eddcbd79ebbc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:32:57 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] Creating volume a8eab4ea-f0c4-4a2c-989a-5b150705d041 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:32:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:57 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:32:57 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:32:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:57 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:32:57 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:32:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a8eab4ea-f0c4-4a2c-989a-5b150705d041 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:57 devstack sudo[83760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a8eab4ea-f0c4-4a2c-989a-5b150705d041 1073741824 Apr 10 10:32:57 devstack sudo[83760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:57 devstack sudo[83753]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-df669e07-1fa2-45d1-aa1c-a0573db9ff72 tempest-ServersNegativeTestJSON-1196717886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5c229e9c-2acf-4b16-a43d-ff30d2ccc150" returned: 0 in 2.458s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:58 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-df669e07-1fa2-45d1-aa1c-a0573db9ff72 tempest-ServersNegativeTestJSON-1196717886 None] Lock "cinder-quobyte-5c229e9c-2acf-4b16-a43d-ff30d2ccc150" released by "delete_volume" :: held 3.866s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:58 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-df669e07-1fa2-45d1-aa1c-a0573db9ff72 tempest-ServersNegativeTestJSON-1196717886 None] Created reservations ['202524e2-2373-42e1-a413-493c19eaaf50', '8138aed5-d894-4488-83a3-f464b3b48ecf', 'f62cb8e2-a4e2-48b5-95dc-421c6af71719', '63a82304-05cf-4d18-912c-d59fbe952d5e'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:32:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-df669e07-1fa2-45d1-aa1c-a0573db9ff72 tempest-ServersNegativeTestJSON-1196717886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-df669e07-1fa2-45d1-aa1c-a0573db9ff72 tempest-ServersNegativeTestJSON-1196717886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:58 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-df669e07-1fa2-45d1-aa1c-a0573db9ff72 tempest-ServersNegativeTestJSON-1196717886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:32:58 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-df669e07-1fa2-45d1-aa1c-a0573db9ff72 tempest-ServersNegativeTestJSON-1196717886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:32:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-df669e07-1fa2-45d1-aa1c-a0573db9ff72 tempest-ServersNegativeTestJSON-1196717886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-df669e07-1fa2-45d1-aa1c-a0573db9ff72 tempest-ServersNegativeTestJSON-1196717886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:58 devstack sudo[83764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:32:58 devstack sudo[83764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:00 devstack sudo[83760]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a8eab4ea-f0c4-4a2c-989a-5b150705d041 1073741824" returned: 0 in 2.901s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a8eab4ea-f0c4-4a2c-989a-5b150705d041 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:00 devstack sudo[83779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a8eab4ea-f0c4-4a2c-989a-5b150705d041 Apr 10 10:33:00 devstack sudo[83779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:00 devstack sudo[83764]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-df669e07-1fa2-45d1-aa1c-a0573db9ff72 tempest-ServersNegativeTestJSON-1196717886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 2.280s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:00 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-df669e07-1fa2-45d1-aa1c-a0573db9ff72 tempest-ServersNegativeTestJSON-1196717886 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:33:00 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-df669e07-1fa2-45d1-aa1c-a0573db9ff72 tempest-ServersNegativeTestJSON-1196717886 None] Deleted volume successfully. Apr 10 10:33:00 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-df669e07-1fa2-45d1-aa1c-a0573db9ff72 tempest-ServersNegativeTestJSON-1196717886 None] Lock "cinder-5c229e9c-2acf-4b16-a43d-ff30d2ccc150-delete_volume" released by "delete_volume" :: held 6.732s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:01 devstack sudo[83779]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a8eab4ea-f0c4-4a2c-989a-5b150705d041" returned: 0 in 1.293s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:01 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] <== create_volume: return (4340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:33:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.343s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fdb41c7-c064-451a-bc73-708da1f8e261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8eab4ea-f0c4-4a2c-989a-5b150705d041', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e102ec1-1060-4a89-aba5-ce1938fd88c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:01 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] Volume volume-a8eab4ea-f0c4-4a2c-989a-5b150705d041 (a8eab4ea-f0c4-4a2c-989a-5b150705d041): created successfully Apr 10 10:33:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e102ec1-1060-4a89-aba5-ce1938fd88c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] Flow 'volume_create_manager' (6fedc84a-ebd5-4947-96dd-ab27c6f7b62e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:01 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-abb3d3b2-4303-4fcf-bf43-7203671ea6c8 tempest-ServerRescueNegativeTestJSON-1780588093 None] Created volume successfully. Apr 10 10:33:11 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writing DB stats cinder:SELECT=17,cinder:UPDATE=30,cinder:DELETE=2,cinder:INSERT=4 {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:33:11 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writing DB stats cinder:SELECT=16,cinder:UPDATE=21,cinder:INSERT=7,cinder:DELETE=3 {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:33:20 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-350b19e2-f0ab-43fa-a98b-8902f3c8fb58 tempest-ServerRescueNegativeTestJSON-1780588093 None] Acquiring lock "cinder-a8eab4ea-f0c4-4a2c-989a-5b150705d041-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-350b19e2-f0ab-43fa-a98b-8902f3c8fb58 tempest-ServerRescueNegativeTestJSON-1780588093 None] Lock "cinder-a8eab4ea-f0c4-4a2c-989a-5b150705d041-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-350b19e2-f0ab-43fa-a98b-8902f3c8fb58 tempest-ServerRescueNegativeTestJSON-1780588093 None] Acquiring lock "cinder-quobyte-a8eab4ea-f0c4-4a2c-989a-5b150705d041" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-350b19e2-f0ab-43fa-a98b-8902f3c8fb58 tempest-ServerRescueNegativeTestJSON-1780588093 None] Lock "cinder-quobyte-a8eab4ea-f0c4-4a2c-989a-5b150705d041" acquired by "delete_volume" :: waited 0.032s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:21 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee86b15a-cd08-498a-bc6d-ea59ae508617]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-350b19e2-f0ab-43fa-a98b-8902f3c8fb58 tempest-ServerRescueNegativeTestJSON-1780588093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a8eab4ea-f0c4-4a2c-989a-5b150705d041 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:21 devstack sudo[84022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a8eab4ea-f0c4-4a2c-989a-5b150705d041 Apr 10 10:33:21 devstack sudo[84022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:22 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:33:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] Flow 'volume_create_manager' (5e3f6ef2-c0c6-4113-92d2-be579e1ee5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2d1860a-9408-4c6c-be84-3b2f32627d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2d1860a-9408-4c6c-be84-3b2f32627d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-741752683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5969d755-11d8-44bc-b85a-bccb59c285c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f306742e0cce40f4a80fd6649dae9927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:22Z,use_quota=True,user_id='b8b7da32a31843818db85ecc0d6c95fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9524891d-6bca-4ae2-97d9-26dd05e686d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9524891d-6bca-4ae2-97d9-26dd05e686d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b6403e-0ee1-405c-b35b-19119b1e9390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b6403e-0ee1-405c-b35b-19119b1e9390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5969d755-11d8-44bc-b85a-bccb59c285c2', 'volume_name': 'volume-5969d755-11d8-44bc-b85a-bccb59c285c2', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (881764c5-0f7a-4c68-9a20-ff4c89832d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (881764c5-0f7a-4c68-9a20-ff4c89832d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70e9928-6340-42ef-b4ac-1bbe50243368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:22 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] Volume 5969d755-11d8-44bc-b85a-bccb59c285c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5969d755-11d8-44bc-b85a-bccb59c285c2', 'volume_size': 1} Apr 10 10:33:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-741752683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5969d755-11d8-44bc-b85a-bccb59c285c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f306742e0cce40f4a80fd6649dae9927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:22Z,use_quota=True,user_id='b8b7da32a31843818db85ecc0d6c95fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:33:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] Creating volume 5969d755-11d8-44bc-b85a-bccb59c285c2 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:33:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:33:22 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:33:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5969d755-11d8-44bc-b85a-bccb59c285c2 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:22 devstack sudo[84034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5969d755-11d8-44bc-b85a-bccb59c285c2 1073741824 Apr 10 10:33:22 devstack sudo[84034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:22 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-dc1f24d9-5d98-4b6b-b793-38c121baa8e6 tempest-GroupSnapshotsV319Test-14007804 None] Group tempest-GroupSnapshotsV319Test-Group-1988913196: creating Apr 10 10:33:22 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-dc1f24d9-5d98-4b6b-b793-38c121baa8e6 tempest-GroupSnapshotsV319Test-14007804 None] Group tempest-GroupSnapshotsV319Test-Group-1988913196: created successfully Apr 10 10:33:22 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-dc1f24d9-5d98-4b6b-b793-38c121baa8e6 tempest-GroupSnapshotsV319Test-14007804 None] Create group completed successfully. Apr 10 10:33:23 devstack sudo[84022]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-350b19e2-f0ab-43fa-a98b-8902f3c8fb58 tempest-ServerRescueNegativeTestJSON-1780588093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a8eab4ea-f0c4-4a2c-989a-5b150705d041" returned: 0 in 1.702s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-350b19e2-f0ab-43fa-a98b-8902f3c8fb58 tempest-ServerRescueNegativeTestJSON-1780588093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a8eab4ea-f0c4-4a2c-989a-5b150705d041 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:23 devstack sudo[84049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a8eab4ea-f0c4-4a2c-989a-5b150705d041 Apr 10 10:33:23 devstack sudo[84049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:23 devstack sudo[84049]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-350b19e2-f0ab-43fa-a98b-8902f3c8fb58 tempest-ServerRescueNegativeTestJSON-1780588093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a8eab4ea-f0c4-4a2c-989a-5b150705d041" returned: 0 in 0.596s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:23 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-350b19e2-f0ab-43fa-a98b-8902f3c8fb58 tempest-ServerRescueNegativeTestJSON-1780588093 None] Lock "cinder-quobyte-a8eab4ea-f0c4-4a2c-989a-5b150705d041" released by "delete_volume" :: held 2.444s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:23 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-350b19e2-f0ab-43fa-a98b-8902f3c8fb58 tempest-ServerRescueNegativeTestJSON-1780588093 None] Created reservations ['6ed88299-1642-4e5c-a824-3957ea86d6e4', '7c792ada-a9b7-4b79-82ed-34d548614514', '75ec4d0c-a1a3-4370-959c-55ca524c99c9', 'f94f9c34-b2d6-4d81-87ae-a03f259ca0c5'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-350b19e2-f0ab-43fa-a98b-8902f3c8fb58 tempest-ServerRescueNegativeTestJSON-1780588093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-350b19e2-f0ab-43fa-a98b-8902f3c8fb58 tempest-ServerRescueNegativeTestJSON-1780588093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:23 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-350b19e2-f0ab-43fa-a98b-8902f3c8fb58 tempest-ServerRescueNegativeTestJSON-1780588093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:23 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-350b19e2-f0ab-43fa-a98b-8902f3c8fb58 tempest-ServerRescueNegativeTestJSON-1780588093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-350b19e2-f0ab-43fa-a98b-8902f3c8fb58 tempest-ServerRescueNegativeTestJSON-1780588093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-350b19e2-f0ab-43fa-a98b-8902f3c8fb58 tempest-ServerRescueNegativeTestJSON-1780588093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:23 devstack sudo[84061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:33:23 devstack sudo[84061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:23 devstack sudo[84034]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5969d755-11d8-44bc-b85a-bccb59c285c2 1073741824" returned: 0 in 1.222s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5969d755-11d8-44bc-b85a-bccb59c285c2 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:24 devstack sudo[84063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5969d755-11d8-44bc-b85a-bccb59c285c2 Apr 10 10:33:24 devstack sudo[84063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:24 devstack sudo[84061]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-350b19e2-f0ab-43fa-a98b-8902f3c8fb58 tempest-ServerRescueNegativeTestJSON-1780588093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.988s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:24 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-350b19e2-f0ab-43fa-a98b-8902f3c8fb58 tempest-ServerRescueNegativeTestJSON-1780588093 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:33:24 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-350b19e2-f0ab-43fa-a98b-8902f3c8fb58 tempest-ServerRescueNegativeTestJSON-1780588093 None] Deleted volume successfully. Apr 10 10:33:24 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:33:24 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] Flow 'volume_create_manager' (4abab9e5-6ce8-46f4-b2ac-d49c159a3290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:24 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eff154d7-7d4b-4b83-a30b-21239340a5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:24 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eff154d7-7d4b-4b83-a30b-21239340a5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1346666955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7aeb10a-6653-4e64-85b9-a78ca0714a11,host='devstack@QuobyteHD#QuobyteHD',id=1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a88e1c20a0004a7282456da356e01801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:25Z,use_quota=True,user_id='5a70b958920d4b44946edc1d5d1003c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7523f04-947f-491c-9ac8-39a13f7cab73),volume_type_id=a7523f04-947f-491c-9ac8-39a13f7cab73)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:24 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f193535b-319b-43c3-9364-de87e6f2d971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:24 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f193535b-319b-43c3-9364-de87e6f2d971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70640146-491a-45cc-ab7d-9dcc316b16d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70640146-491a-45cc-ab7d-9dcc316b16d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9', 'volume_name': 'volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85710097-f843-45c8-a0ad-90e0bd6a526a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85710097-f843-45c8-a0ad-90e0bd6a526a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6258e6fe-8cfa-435a-a50e-5f49b5039a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:25 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] Volume 1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9', 'volume_size': 1} Apr 10 10:33:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-350b19e2-f0ab-43fa-a98b-8902f3c8fb58 tempest-ServerRescueNegativeTestJSON-1780588093 None] Lock "cinder-a8eab4ea-f0c4-4a2c-989a-5b150705d041-delete_volume" released by "delete_volume" :: held 4.015s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:25 devstack sudo[84063]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5969d755-11d8-44bc-b85a-bccb59c285c2" returned: 0 in 1.175s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] <== create_volume: return (2468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:33:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.472s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.153s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f7aeb10a-6653-4e64-85b9-a78ca0714a11,created_at=2026-04-10T08:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1346666955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7aeb10a-6653-4e64-85b9-a78ca0714a11,host='devstack@QuobyteHD#QuobyteHD',id=1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a88e1c20a0004a7282456da356e01801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:25Z,use_quota=True,user_id='5a70b958920d4b44946edc1d5d1003c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7523f04-947f-491c-9ac8-39a13f7cab73),volume_type_id=a7523f04-947f-491c-9ac8-39a13f7cab73)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:33:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] Creating volume 1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:33:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:33:25 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:33:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70e9928-6340-42ef-b4ac-1bbe50243368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5969d755-11d8-44bc-b85a-bccb59c285c2', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:25 devstack sudo[84072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9 1073741824 Apr 10 10:33:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86ce124f-c394-442c-9110-b380d64dd987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:25 devstack sudo[84072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:25 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] Volume volume-5969d755-11d8-44bc-b85a-bccb59c285c2 (5969d755-11d8-44bc-b85a-bccb59c285c2): created successfully Apr 10 10:33:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86ce124f-c394-442c-9110-b380d64dd987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] Flow 'volume_create_manager' (5e3f6ef2-c0c6-4113-92d2-be579e1ee5e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:25 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-7bc7dff4-e3a4-46a7-bd62-5f812c208796 tempest-DeleteServersTestJSON-601938696 None] Created volume successfully. Apr 10 10:33:26 devstack sudo[84072]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9 1073741824" returned: 0 in 1.393s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:26 devstack sudo[84108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9 Apr 10 10:33:26 devstack sudo[84108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:27 devstack sudo[84108]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9" returned: 0 in 1.031s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:27 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] <== create_volume: return (2504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:33:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.507s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6258e6fe-8cfa-435a-a50e-5f49b5039a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc3f950-785b-462d-a4f1-d7ef819a8f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:27 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] Volume volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9 (1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9): created successfully Apr 10 10:33:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc3f950-785b-462d-a4f1-d7ef819a8f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] Flow 'volume_create_manager' (4abab9e5-6ce8-46f4-b2ac-d49c159a3290) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:27 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-3b77a298-c8ee-46cb-bd14-5a5924b39770 tempest-GroupSnapshotsV319Test-14007804 None] Created volume successfully. Apr 10 10:33:29 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-7ba7db1f-b8f5-4896-8c32-770e88d0dec5 tempest-GroupSnapshotsV319Test-14007804 None] GroupSnapshot a9da47b8-4194-4984-937a-937685e5f225: creating. Apr 10 10:33:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7ba7db1f-b8f5-4896-8c32-770e88d0dec5 tempest-GroupSnapshotsV319Test-14007804 None] Group snapshot a9da47b8-4194-4984-937a-937685e5f225: creating. {{(pid=81938) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 10 10:33:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7ba7db1f-b8f5-4896-8c32-770e88d0dec5 tempest-GroupSnapshotsV319Test-14007804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7ba7db1f-b8f5-4896-8c32-770e88d0dec5 tempest-GroupSnapshotsV319Test-14007804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:29 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-7ba7db1f-b8f5-4896-8c32-770e88d0dec5 tempest-GroupSnapshotsV319Test-14007804 None] Creating offline snapshot b5182353-3126-4eca-bca5-9f3f375922c0 of volume 1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9 {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:33:29 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[015bd652-cf04-4c5f-a895-69bb1b225f8c]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7ba7db1f-b8f5-4896-8c32-770e88d0dec5 tempest-GroupSnapshotsV319Test-14007804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-fe5d12cd-4ae7-4ae8-893c-f78b69351330 req-335168bb-36f1-4b5a-a96c-60de8d1d085a tempest-DeleteServersTestJSON-601938696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:29 devstack sudo[84122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9 Apr 10 10:33:29 devstack sudo[84122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:30 devstack sudo[84122]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7ba7db1f-b8f5-4896-8c32-770e88d0dec5 tempest-GroupSnapshotsV319Test-14007804 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9" returned: 0 in 0.961s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7ba7db1f-b8f5-4896-8c32-770e88d0dec5 tempest-GroupSnapshotsV319Test-14007804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9.b5182353-3126-4eca-bca5-9f3f375922c0 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:30 devstack sudo[84128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9.b5182353-3126-4eca-bca5-9f3f375922c0 1G Apr 10 10:33:30 devstack sudo[84128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:31 devstack sudo[84128]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7ba7db1f-b8f5-4896-8c32-770e88d0dec5 tempest-GroupSnapshotsV319Test-14007804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9.b5182353-3126-4eca-bca5-9f3f375922c0 1G" returned: 0 in 0.933s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7ba7db1f-b8f5-4896-8c32-770e88d0dec5 tempest-GroupSnapshotsV319Test-14007804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9.b5182353-3126-4eca-bca5-9f3f375922c0 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:31 devstack sudo[84135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9.b5182353-3126-4eca-bca5-9f3f375922c0 Apr 10 10:33:31 devstack sudo[84135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:31 devstack sudo[84135]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7ba7db1f-b8f5-4896-8c32-770e88d0dec5 tempest-GroupSnapshotsV319Test-14007804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9.b5182353-3126-4eca-bca5-9f3f375922c0" returned: 0 in 0.580s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:31 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-7ba7db1f-b8f5-4896-8c32-770e88d0dec5 tempest-GroupSnapshotsV319Test-14007804 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9.b5182353-3126-4eca-bca5-9f3f375922c0 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:33:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7ba7db1f-b8f5-4896-8c32-770e88d0dec5 tempest-GroupSnapshotsV319Test-14007804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9.b5182353-3126-4eca-bca5-9f3f375922c0 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:31 devstack sudo[84140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9.b5182353-3126-4eca-bca5-9f3f375922c0 Apr 10 10:33:31 devstack sudo[84140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:32 devstack sudo[84140]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7ba7db1f-b8f5-4896-8c32-770e88d0dec5 tempest-GroupSnapshotsV319Test-14007804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9.b5182353-3126-4eca-bca5-9f3f375922c0" returned: 0 in 0.518s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7ba7db1f-b8f5-4896-8c32-770e88d0dec5 tempest-GroupSnapshotsV319Test-14007804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:32 devstack sudo[84143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9.info Apr 10 10:33:32 devstack sudo[84143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:32 devstack sudo[84143]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7ba7db1f-b8f5-4896-8c32-770e88d0dec5 tempest-GroupSnapshotsV319Test-14007804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9.info" returned: 0 in 0.759s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:32 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-7ba7db1f-b8f5-4896-8c32-770e88d0dec5 tempest-GroupSnapshotsV319Test-14007804 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:33:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7ba7db1f-b8f5-4896-8c32-770e88d0dec5 tempest-GroupSnapshotsV319Test-14007804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:33 devstack sudo[84147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9.info Apr 10 10:33:33 devstack sudo[84147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:33 devstack sudo[84147]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7ba7db1f-b8f5-4896-8c32-770e88d0dec5 tempest-GroupSnapshotsV319Test-14007804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9.info" returned: 0 in 0.810s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7ba7db1f-b8f5-4896-8c32-770e88d0dec5 tempest-GroupSnapshotsV319Test-14007804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.657s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-fe5d12cd-4ae7-4ae8-893c-f78b69351330 req-335168bb-36f1-4b5a-a96c-60de8d1d085a tempest-DeleteServersTestJSON-601938696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.587s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:33 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c17e14-eb5a-4017-b3e0-391c3cff7789]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-fe5d12cd-4ae7-4ae8-893c-f78b69351330 req-335168bb-36f1-4b5a-a96c-60de8d1d085a tempest-DeleteServersTestJSON-601938696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5969d755-11d8-44bc-b85a-bccb59c285c2 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:34 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-7ba7db1f-b8f5-4896-8c32-770e88d0dec5 tempest-GroupSnapshotsV319Test-14007804 None] group_snapshot a9da47b8-4194-4984-937a-937685e5f225: created successfully Apr 10 10:33:34 devstack sudo[84172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5969d755-11d8-44bc-b85a-bccb59c285c2 Apr 10 10:33:34 devstack sudo[84172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:34 devstack sudo[84172]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-fe5d12cd-4ae7-4ae8-893c-f78b69351330 req-335168bb-36f1-4b5a-a96c-60de8d1d085a tempest-DeleteServersTestJSON-601938696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5969d755-11d8-44bc-b85a-bccb59c285c2" returned: 0 in 0.808s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-fe5d12cd-4ae7-4ae8-893c-f78b69351330 req-335168bb-36f1-4b5a-a96c-60de8d1d085a tempest-DeleteServersTestJSON-601938696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.859s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:34 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-fe5d12cd-4ae7-4ae8-893c-f78b69351330 req-335168bb-36f1-4b5a-a96c-60de8d1d085a tempest-DeleteServersTestJSON-601938696 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4', 'name': 'volume-5969d755-11d8-44bc-b85a-bccb59c285c2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b5331f34-23f9-4c46-8bf7-39290b7b961a', 'enforce_multipath': True} {{(pid=81938) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 10 10:33:34 devstack cinder-volume[81938]: INFO cinder.volume.manager [req-fe5d12cd-4ae7-4ae8-893c-f78b69351330 req-335168bb-36f1-4b5a-a96c-60de8d1d085a tempest-DeleteServersTestJSON-601938696 None] attachment_update completed successfully. Apr 10 10:33:35 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-432c1a0d-0b3a-4611-9264-b72b1ac2a47c tempest-GroupSnapshotsV319Test-14007804 None] group_snapshot a9da47b8-4194-4984-937a-937685e5f225: deleting Apr 10 10:33:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-432c1a0d-0b3a-4611-9264-b72b1ac2a47c tempest-GroupSnapshotsV319Test-14007804 None] group_snapshot a9da47b8-4194-4984-937a-937685e5f225: deleting {{(pid=81938) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 10 10:33:35 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-432c1a0d-0b3a-4611-9264-b72b1ac2a47c tempest-GroupSnapshotsV319Test-14007804 None] Acquiring lock "cinder-quobyte-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:35 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-432c1a0d-0b3a-4611-9264-b72b1ac2a47c tempest-GroupSnapshotsV319Test-14007804 None] Lock "cinder-quobyte-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:35 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-432c1a0d-0b3a-4611-9264-b72b1ac2a47c tempest-GroupSnapshotsV319Test-14007804 None] Acquiring lock "cinder-quobyte-b5182353-3126-4eca-bca5-9f3f375922c0" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:35 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-432c1a0d-0b3a-4611-9264-b72b1ac2a47c tempest-GroupSnapshotsV319Test-14007804 None] Lock "cinder-quobyte-b5182353-3126-4eca-bca5-9f3f375922c0" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:35 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-432c1a0d-0b3a-4611-9264-b72b1ac2a47c tempest-GroupSnapshotsV319Test-14007804 None] Deleting offline snapshot b5182353-3126-4eca-bca5-9f3f375922c0 of volume 1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:33:35 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-432c1a0d-0b3a-4611-9264-b72b1ac2a47c tempest-GroupSnapshotsV319Test-14007804 None] snapshot_file for this snap is: volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9.b5182353-3126-4eca-bca5-9f3f375922c0 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:33:35 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd0bfe7-0803-4096-a1ba-7f9b8c890417]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-432c1a0d-0b3a-4611-9264-b72b1ac2a47c tempest-GroupSnapshotsV319Test-14007804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9.b5182353-3126-4eca-bca5-9f3f375922c0 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:35 devstack sudo[84179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9.b5182353-3126-4eca-bca5-9f3f375922c0 Apr 10 10:33:35 devstack sudo[84179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:36 devstack sudo[84179]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-432c1a0d-0b3a-4611-9264-b72b1ac2a47c tempest-GroupSnapshotsV319Test-14007804 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9.b5182353-3126-4eca-bca5-9f3f375922c0" returned: 0 in 1.012s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:36 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-432c1a0d-0b3a-4611-9264-b72b1ac2a47c tempest-GroupSnapshotsV319Test-14007804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:33:36 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c58d69-1c3b-4fb1-bbb0-a11e72b10534]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-432c1a0d-0b3a-4611-9264-b72b1ac2a47c tempest-GroupSnapshotsV319Test-14007804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:36 devstack sudo[84188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9 Apr 10 10:33:36 devstack sudo[84188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:37 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:33:37 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Flow 'volume_create_manager' (8e2f9e4a-071d-4717-96b9-830e7e7aaec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:37 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc1ae22-c833-4f72-97a7-1dd9a49089ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:37 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc1ae22-c833-4f72-97a7-1dd9a49089ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:33:37Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8920fde9-05b9-496d-bd36-76ff1fe208c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b234d731de441beb064c25ea9a7303e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:38Z,use_quota=True,user_id='f187b22beb5143ed8c15e210b80f4a1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:37 devstack sudo[84188]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:37 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd19a96-76c6-4383-9c3b-578276e00c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:37 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd19a96-76c6-4383-9c3b-578276e00c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:37 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d86508-8344-4ec5-add1-77223c2fa571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:37 devstack cinder-volume[81938]: DEBUG cinder.image.glance [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Creating Keystone auth plugin from conf {{(pid=81938) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 10 10:33:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-432c1a0d-0b3a-4611-9264-b72b1ac2a47c tempest-GroupSnapshotsV319Test-14007804 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9" returned: 0 in 1.389s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-432c1a0d-0b3a-4611-9264-b72b1ac2a47c tempest-GroupSnapshotsV319Test-14007804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9.b5182353-3126-4eca-bca5-9f3f375922c0 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:37 devstack sudo[84193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9.b5182353-3126-4eca-bca5-9f3f375922c0 Apr 10 10:33:37 devstack sudo[84193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:38 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d86508-8344-4ec5-add1-77223c2fa571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8920fde9-05b9-496d-bd36-76ff1fe208c8', 'volume_name': 'volume-8920fde9-05b9-496d-bd36-76ff1fe208c8', 'volume_size': 1, 'image_id': '8dcf7229-52df-43f5-84c5-2e0276bc541d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf7229-52df-43f5-84c5-2e0276bc541d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '52e7a0ecf90345dca974afb11cfc67b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8dcf7229-52df-43f5-84c5-2e0276bc541d', 'created_at': datetime.datetime(2026, 4, 10, 8, 27, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 27, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dcf7229-52df-43f5-84c5-2e0276bc541d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:38 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8dadfa0-8775-4a10-83e2-615883457fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:38 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8dadfa0-8775-4a10-83e2-615883457fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:38 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (665ebe1b-07be-43e3-a66f-67bea1033e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:38 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Volume 8920fde9-05b9-496d-bd36-76ff1fe208c8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8920fde9-05b9-496d-bd36-76ff1fe208c8', 'volume_size': 1, 'image_id': '8dcf7229-52df-43f5-84c5-2e0276bc541d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf7229-52df-43f5-84c5-2e0276bc541d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '52e7a0ecf90345dca974afb11cfc67b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8dcf7229-52df-43f5-84c5-2e0276bc541d', 'created_at': datetime.datetime(2026, 4, 10, 8, 27, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 27, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dcf7229-52df-43f5-84c5-2e0276bc541d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 10 10:33:38 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Trying to clone 8920fde9-05b9-496d-bd36-76ff1fe208c8 from image 8dcf7229-52df-43f5-84c5-2e0276bc541d at location (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf7229-52df-43f5-84c5-2e0276bc541d', 'metadata': {}}]). {{(pid=81938) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 10 10:33:38 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_nbs2knt6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81938) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 10 10:33:38 devstack cinder-volume[81938]: INFO cinder.image.image_utils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Image download 20.69 MB at 20.69 MB/s Apr 10 10:33:38 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a15a92-41ba-4196-b830-6934f8dc7a9d]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_nbs2knt6devstack@QuobyteHD {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:38 devstack sudo[84220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_nbs2knt6devstack@QuobyteHD Apr 10 10:33:38 devstack sudo[84220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:39 devstack sudo[84193]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-432c1a0d-0b3a-4611-9264-b72b1ac2a47c tempest-GroupSnapshotsV319Test-14007804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9.b5182353-3126-4eca-bca5-9f3f375922c0" returned: 0 in 1.198s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-432c1a0d-0b3a-4611-9264-b72b1ac2a47c tempest-GroupSnapshotsV319Test-14007804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9.b5182353-3126-4eca-bca5-9f3f375922c0 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:39 devstack sudo[84222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9.b5182353-3126-4eca-bca5-9f3f375922c0 Apr 10 10:33:39 devstack sudo[84222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:39 devstack sudo[84220]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_nbs2knt6devstack@QuobyteHD" returned: 0 in 0.890s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:39 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Temporary image 8dcf7229-52df-43f5-84c5-2e0276bc541d is fetched for user f187b22beb5143ed8c15e210b80f4a1d. {{(pid=81938) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 10 10:33:39 devstack sudo[84222]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-432c1a0d-0b3a-4611-9264-b72b1ac2a47c tempest-GroupSnapshotsV319Test-14007804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9.b5182353-3126-4eca-bca5-9f3f375922c0" returned: 0 in 0.646s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:39 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-432c1a0d-0b3a-4611-9264-b72b1ac2a47c tempest-GroupSnapshotsV319Test-14007804 None] Lock "cinder-quobyte-b5182353-3126-4eca-bca5-9f3f375922c0" released by "_delete_snapshot" :: held 4.464s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:39 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-432c1a0d-0b3a-4611-9264-b72b1ac2a47c tempest-GroupSnapshotsV319Test-14007804 None] Lock "cinder-quobyte-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9" released by "delete_snapshot" :: held 4.502s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:39 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[d031ea5c-936e-41c1-9105-0a97372802fb]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_nbs2knt6devstack@QuobyteHD {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:40 devstack cinder-volume[81938]: WARNING cinder.quota [None req-432c1a0d-0b3a-4611-9264-b72b1ac2a47c tempest-GroupSnapshotsV319Test-14007804 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1455110957 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1455110957, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:33:40 devstack cinder-volume[81938]: WARNING cinder.quota [None req-432c1a0d-0b3a-4611-9264-b72b1ac2a47c tempest-GroupSnapshotsV319Test-14007804 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1455110957 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1455110957, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:33:40 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-432c1a0d-0b3a-4611-9264-b72b1ac2a47c tempest-GroupSnapshotsV319Test-14007804 None] Created reservations ['80315498-ba35-497c-89a4-12f74c56f55e', '4a241758-987a-49f4-8681-b0d03cd8a971', '54e1f4a8-ba49-441a-9aee-4dfe00330597', 'a770f997-f849-406f-994d-6a60f050c7c0'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:40 devstack sudo[84229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_nbs2knt6devstack@QuobyteHD Apr 10 10:33:40 devstack sudo[84229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:40 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-432c1a0d-0b3a-4611-9264-b72b1ac2a47c tempest-GroupSnapshotsV319Test-14007804 None] group_snapshot a9da47b8-4194-4984-937a-937685e5f225: deleted successfully Apr 10 10:33:40 devstack sudo[84229]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_nbs2knt6devstack@QuobyteHD" returned: 0 in 0.997s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:40 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:33:37Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8920fde9-05b9-496d-bd36-76ff1fe208c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b234d731de441beb064c25ea9a7303e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:38Z,use_quota=True,user_id='f187b22beb5143ed8c15e210b80f4a1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:33:40 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Creating volume 8920fde9-05b9-496d-bd36-76ff1fe208c8 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:33:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:40 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:40 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:40 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:33:40 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:33:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:40 devstack sudo[84234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8 1073741824 Apr 10 10:33:40 devstack sudo[84234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:41 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e02938a3-df2a-4d97-b89a-ca302b759ae0 tempest-GroupSnapshotsV319Test-14007804 None] Acquiring lock "cinder-quobyte-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:41 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e02938a3-df2a-4d97-b89a-ca302b759ae0 tempest-GroupSnapshotsV319Test-14007804 None] Lock "cinder-quobyte-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9" acquired by "delete_volume" :: waited 0.028s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:41 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[5483079e-47b3-466f-8f3c-1855e5f7e0e8]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e02938a3-df2a-4d97-b89a-ca302b759ae0 tempest-GroupSnapshotsV319Test-14007804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:41 devstack sudo[84260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9 Apr 10 10:33:41 devstack sudo[84260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:42 devstack sudo[84234]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8 1073741824" returned: 0 in 1.092s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:42 devstack sudo[84268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8 Apr 10 10:33:42 devstack sudo[84268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:42 devstack sudo[84260]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e02938a3-df2a-4d97-b89a-ca302b759ae0 tempest-GroupSnapshotsV319Test-14007804 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9" returned: 0 in 0.869s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e02938a3-df2a-4d97-b89a-ca302b759ae0 tempest-GroupSnapshotsV319Test-14007804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:42 devstack sudo[84274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9 Apr 10 10:33:42 devstack sudo[84274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:42 devstack sudo[84268]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8" returned: 0 in 0.508s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:42 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:33:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:42 devstack cinder-volume[81938]: DEBUG cinder.volume.volume_utils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Attempting download of 8dcf7229-52df-43f5-84c5-2e0276bc541d ((None, [{'url': 'file:///opt/stack/data/glance/images/8dcf7229-52df-43f5-84c5-2e0276bc541d', 'metadata': {}}])) to volume 8920fde9-05b9-496d-bd36-76ff1fe208c8. {{(pid=81938) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 10 10:33:42 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcea3bf-f889-42bf-9a36-280db5fc9ee3]: (4, 'raw') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dcf7229-52df-43f5-84c5-2e0276bc541d_382i876l {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:42 devstack sudo[84276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dcf7229-52df-43f5-84c5-2e0276bc541d_382i876l Apr 10 10:33:42 devstack sudo[84276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:43 devstack sudo[84276]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dcf7229-52df-43f5-84c5-2e0276bc541d_382i876l" returned: 0 in 0.833s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf7229-52df-43f5-84c5-2e0276bc541d_382i876l {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:43 devstack sudo[84274]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e02938a3-df2a-4d97-b89a-ca302b759ae0 tempest-GroupSnapshotsV319Test-14007804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9" returned: 0 in 1.012s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:43 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e02938a3-df2a-4d97-b89a-ca302b759ae0 tempest-GroupSnapshotsV319Test-14007804 None] Lock "cinder-quobyte-1ce28fb1-e0cb-4988-bb3e-30b8807b5aa9" released by "delete_volume" :: held 2.016s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:43 devstack sudo[84282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf7229-52df-43f5-84c5-2e0276bc541d_382i876l Apr 10 10:33:43 devstack sudo[84282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:43 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-e02938a3-df2a-4d97-b89a-ca302b759ae0 tempest-GroupSnapshotsV319Test-14007804 None] Created reservations ['5f44111e-b8c4-4546-bab9-a3456bad730c'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:43 devstack cinder-volume[81938]: WARNING cinder.quota [None req-e02938a3-df2a-4d97-b89a-ca302b759ae0 tempest-GroupSnapshotsV319Test-14007804 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1455110957 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1455110957, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:33:43 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-e02938a3-df2a-4d97-b89a-ca302b759ae0 tempest-GroupSnapshotsV319Test-14007804 None] Created reservations ['cdf926b3-9a37-4944-9b44-d1ffe68bdb1e', '5ebecdc5-ce0b-4efd-922e-9bc581e72885', '92ec0306-2f24-4be9-8264-95946279a5c1', '3e117112-b607-4188-96f0-26e88437109d'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e02938a3-df2a-4d97-b89a-ca302b759ae0 tempest-GroupSnapshotsV319Test-14007804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e02938a3-df2a-4d97-b89a-ca302b759ae0 tempest-GroupSnapshotsV319Test-14007804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:43 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e02938a3-df2a-4d97-b89a-ca302b759ae0 tempest-GroupSnapshotsV319Test-14007804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:43 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e02938a3-df2a-4d97-b89a-ca302b759ae0 tempest-GroupSnapshotsV319Test-14007804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e02938a3-df2a-4d97-b89a-ca302b759ae0 tempest-GroupSnapshotsV319Test-14007804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e02938a3-df2a-4d97-b89a-ca302b759ae0 tempest-GroupSnapshotsV319Test-14007804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:43 devstack sudo[84284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:33:43 devstack sudo[84284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:44 devstack sudo[84282]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf7229-52df-43f5-84c5-2e0276bc541d_382i876l" returned: 1 in 0.653s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf7229-52df-43f5-84c5-2e0276bc541d_382i876l' failed. Not Retrying. {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:33:44 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3aa347-732c-4dd8-a3bc-ee1c2d440fc3]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_nbs2knt6devstack@QuobyteHD {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:44 devstack cinder-volume[81938]: INFO cinder.volume.manager [req-f823654b-65f6-4131-94e6-02d4bad6655b req-852ed7a9-ebd2-420a-8366-d3905b70b082 tempest-DeleteServersTestJSON-601938696 None] Terminate volume connection completed successfully. Apr 10 10:33:44 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-f823654b-65f6-4131-94e6-02d4bad6655b req-852ed7a9-ebd2-420a-8366-d3905b70b082 tempest-DeleteServersTestJSON-601938696 None] Deleting attachment b5331f34-23f9-4c46-8bf7-39290b7b961a. {{(pid=81938) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 10 10:33:44 devstack sudo[84288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_nbs2knt6devstack@QuobyteHD Apr 10 10:33:44 devstack sudo[84288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:44 devstack sudo[84284]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e02938a3-df2a-4d97-b89a-ca302b759ae0 tempest-GroupSnapshotsV319Test-14007804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.721s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:44 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-e02938a3-df2a-4d97-b89a-ca302b759ae0 tempest-GroupSnapshotsV319Test-14007804 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:33:44 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-e02938a3-df2a-4d97-b89a-ca302b759ae0 tempest-GroupSnapshotsV319Test-14007804 None] Delete group completed successfully. Apr 10 10:33:44 devstack sudo[84288]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_nbs2knt6devstack@QuobyteHD" returned: 0 in 0.825s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:44 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] 8dcf7229-52df-43f5-84c5-2e0276bc541d was qcow2, converting to raw {{(pid=81938) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 10 10:33:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_nbs2knt6devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:45 devstack sudo[84295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_nbs2knt6devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8 Apr 10 10:33:45 devstack sudo[84295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:46 devstack sudo[84295]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_nbs2knt6devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8" returned: 0 in 1.510s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:46 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_nbs2knt6devstack@QuobyteHD, size 112.00 MB, duration 1.51 sec, destination /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8 {{(pid=81938) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:33:46 devstack cinder-volume[81938]: INFO cinder.image.image_utils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Converted 112.00 MB image at 74.09 MB/s Apr 10 10:33:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:46 devstack sudo[84309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8 1G Apr 10 10:33:46 devstack sudo[84309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:47 devstack sudo[84309]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8 1G" returned: 0 in 0.874s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:47 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[52eb5dc3-ba83-4a32-b8d1-6cedaf2744c7]: (4, 'raw') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:47 devstack sudo[84328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8 Apr 10 10:33:47 devstack sudo[84328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:48 devstack cinder-volume[81938]: DEBUG oslo_service.periodic_task [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81938) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:33:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:48 devstack sudo[84328]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8" returned: 0 in 0.671s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:48 devstack sudo[84332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:33:48 devstack sudo[84332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:48 devstack sudo[84333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8 Apr 10 10:33:48 devstack sudo[84333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:48 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-66eecc4f-6294-4b8d-a0a8-1937ac68ccd2 tempest-DeleteServersTestJSON-601938696 None] Acquiring lock "cinder-5969d755-11d8-44bc-b85a-bccb59c285c2-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:48 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-66eecc4f-6294-4b8d-a0a8-1937ac68ccd2 tempest-DeleteServersTestJSON-601938696 None] Lock "cinder-5969d755-11d8-44bc-b85a-bccb59c285c2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:48 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-66eecc4f-6294-4b8d-a0a8-1937ac68ccd2 tempest-DeleteServersTestJSON-601938696 None] Acquiring lock "cinder-quobyte-5969d755-11d8-44bc-b85a-bccb59c285c2" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:48 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-66eecc4f-6294-4b8d-a0a8-1937ac68ccd2 tempest-DeleteServersTestJSON-601938696 None] Lock "cinder-quobyte-5969d755-11d8-44bc-b85a-bccb59c285c2" acquired by "delete_volume" :: waited 0.014s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:48 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d250e4d-4935-4326-84be-e743084ac471]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-66eecc4f-6294-4b8d-a0a8-1937ac68ccd2 tempest-DeleteServersTestJSON-601938696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5969d755-11d8-44bc-b85a-bccb59c285c2 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:48 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-de657986-2d3c-4cf5-be74-bb044a116920 tempest-BackendsCapabilitiesAdminTestsJSON-312795967 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579803466797, 'free_capacity_gb': 1775.7579803466797, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81938) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 10 10:33:48 devstack sudo[84342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5969d755-11d8-44bc-b85a-bccb59c285c2 Apr 10 10:33:48 devstack sudo[84342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:48 devstack sudo[84332]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.815s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:48 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:33:49 devstack sudo[84333]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8" returned: 1 in 0.998s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8' failed. Not Retrying. {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:33:49 devstack cinder-volume[81938]: DEBUG cinder.volume.volume_utils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Downloaded image 8dcf7229-52df-43f5-84c5-2e0276bc541d ((None, [{'url': 'file:///opt/stack/data/glance/images/8dcf7229-52df-43f5-84c5-2e0276bc541d', 'metadata': {}}])) to volume 8920fde9-05b9-496d-bd36-76ff1fe208c8 successfully. {{(pid=81938) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 10 10:33:49 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Temporary image 8dcf7229-52df-43f5-84c5-2e0276bc541d for user f187b22beb5143ed8c15e210b80f4a1d is deleted. {{(pid=81938) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 10 10:33:49 devstack cinder-volume[81938]: DEBUG cinder.volume.volume_utils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Marking volume 8920fde9-05b9-496d-bd36-76ff1fe208c8 as bootable. {{(pid=81938) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 10 10:33:49 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Copying metadata from image 8dcf7229-52df-43f5-84c5-2e0276bc541d to 8920fde9-05b9-496d-bd36-76ff1fe208c8. {{(pid=81938) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 10 10:33:49 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Creating volume glance metadata for volume 8920fde9-05b9-496d-bd36-76ff1fe208c8 backed by image 8dcf7229-52df-43f5-84c5-2e0276bc541d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8dcf7229-52df-43f5-84c5-2e0276bc541d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81938) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 10 10:33:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (665ebe1b-07be-43e3-a66f-67bea1033e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8920fde9-05b9-496d-bd36-76ff1fe208c8', 'volume_size': 1, 'image_id': '8dcf7229-52df-43f5-84c5-2e0276bc541d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf7229-52df-43f5-84c5-2e0276bc541d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '52e7a0ecf90345dca974afb11cfc67b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8dcf7229-52df-43f5-84c5-2e0276bc541d', 'created_at': datetime.datetime(2026, 4, 10, 8, 27, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 27, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dcf7229-52df-43f5-84c5-2e0276bc541d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cba3563-9508-47d3-9cfc-912847f94cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:49 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Volume volume-8920fde9-05b9-496d-bd36-76ff1fe208c8 (8920fde9-05b9-496d-bd36-76ff1fe208c8): created successfully Apr 10 10:33:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cba3563-9508-47d3-9cfc-912847f94cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Flow 'volume_create_manager' (8e2f9e4a-071d-4717-96b9-830e7e7aaec3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:49 devstack cinder-volume[81938]: INFO cinder.volume.manager [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-affa6587-4a73-4901-9919-1dd4ad1c180b tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Created volume successfully. Apr 10 10:33:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a35dd167-79a1-4523-8722-9333c349d71a tempest-BackendsCapabilitiesAdminTestsJSON-312795967 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579803466797, 'free_capacity_gb': 1775.7579803466797, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81938) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 10 10:33:49 devstack sudo[84342]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-66eecc4f-6294-4b8d-a0a8-1937ac68ccd2 tempest-DeleteServersTestJSON-601938696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5969d755-11d8-44bc-b85a-bccb59c285c2" returned: 0 in 0.723s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-66eecc4f-6294-4b8d-a0a8-1937ac68ccd2 tempest-DeleteServersTestJSON-601938696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5969d755-11d8-44bc-b85a-bccb59c285c2 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:49 devstack sudo[84352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5969d755-11d8-44bc-b85a-bccb59c285c2 Apr 10 10:33:49 devstack sudo[84352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:50 devstack sudo[84352]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-66eecc4f-6294-4b8d-a0a8-1937ac68ccd2 tempest-DeleteServersTestJSON-601938696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5969d755-11d8-44bc-b85a-bccb59c285c2" returned: 0 in 0.671s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-66eecc4f-6294-4b8d-a0a8-1937ac68ccd2 tempest-DeleteServersTestJSON-601938696 None] Lock "cinder-quobyte-5969d755-11d8-44bc-b85a-bccb59c285c2" released by "delete_volume" :: held 1.473s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-66eecc4f-6294-4b8d-a0a8-1937ac68ccd2 tempest-DeleteServersTestJSON-601938696 None] Created reservations ['4f6cac3a-8bce-47ac-934a-e1ca4628e1b8', 'ea7faa3c-6068-465b-bc9c-274f76764d6d', '17af70bc-2d44-4eff-8d5f-b9a72073639b', '0a16f623-3941-43f8-8606-f05a8cdbaae8'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-66eecc4f-6294-4b8d-a0a8-1937ac68ccd2 tempest-DeleteServersTestJSON-601938696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-66eecc4f-6294-4b8d-a0a8-1937ac68ccd2 tempest-DeleteServersTestJSON-601938696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-66eecc4f-6294-4b8d-a0a8-1937ac68ccd2 tempest-DeleteServersTestJSON-601938696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-66eecc4f-6294-4b8d-a0a8-1937ac68ccd2 tempest-DeleteServersTestJSON-601938696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-66eecc4f-6294-4b8d-a0a8-1937ac68ccd2 tempest-DeleteServersTestJSON-601938696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-66eecc4f-6294-4b8d-a0a8-1937ac68ccd2 tempest-DeleteServersTestJSON-601938696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:50 devstack sudo[84357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:33:50 devstack sudo[84357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] Flow 'volume_create_manager' (8103758d-0563-4428-bd9c-222efb6e53f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f1673c-1c65-447a-8a0a-5b4065e1cb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f1673c-1c65-447a-8a0a-5b4065e1cb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1552043575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2412c9d-1e54-4007-8a34-45472c0541f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730cc1c3f5144b2e93e6de0d7c0e1fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:51Z,use_quota=True,user_id='194244c438594e548f25ed5fd5fc614f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f1e19c-e40c-4817-bdb4-4e828e4ace04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f1e19c-e40c-4817-bdb4-4e828e4ace04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f6cea2a-ab3e-402b-93a9-6575384b4bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f6cea2a-ab3e-402b-93a9-6575384b4bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2412c9d-1e54-4007-8a34-45472c0541f3', 'volume_name': 'volume-b2412c9d-1e54-4007-8a34-45472c0541f3', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee06c28-1889-442c-b0d1-eea9a502f7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee06c28-1889-442c-b0d1-eea9a502f7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d7207b5-09f1-4168-bb90-6082a5529148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:50 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] Volume b2412c9d-1e54-4007-8a34-45472c0541f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2412c9d-1e54-4007-8a34-45472c0541f3', 'volume_size': 1} Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1552043575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2412c9d-1e54-4007-8a34-45472c0541f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730cc1c3f5144b2e93e6de0d7c0e1fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:51Z,use_quota=True,user_id='194244c438594e548f25ed5fd5fc614f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] Creating volume b2412c9d-1e54-4007-8a34-45472c0541f3 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:33:50 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:50 devstack sudo[84366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3 1073741824 Apr 10 10:33:50 devstack sudo[84366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-b117eae4-3992-4793-bfdb-b11b757d6c69 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:51 devstack sudo[84357]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-66eecc4f-6294-4b8d-a0a8-1937ac68ccd2 tempest-DeleteServersTestJSON-601938696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.794s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:51 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-66eecc4f-6294-4b8d-a0a8-1937ac68ccd2 tempest-DeleteServersTestJSON-601938696 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:33:51 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-66eecc4f-6294-4b8d-a0a8-1937ac68ccd2 tempest-DeleteServersTestJSON-601938696 None] Deleted volume successfully. Apr 10 10:33:51 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-66eecc4f-6294-4b8d-a0a8-1937ac68ccd2 tempest-DeleteServersTestJSON-601938696 None] Lock "cinder-5969d755-11d8-44bc-b85a-bccb59c285c2-delete_volume" released by "delete_volume" :: held 2.639s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:51 devstack sudo[84366]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3 1073741824" returned: 0 in 0.856s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:51 devstack sudo[84372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3 Apr 10 10:33:51 devstack sudo[84372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:52 devstack sudo[84372]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3" returned: 0 in 0.787s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:52 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:33:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.673s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-b117eae4-3992-4793-bfdb-b11b757d6c69 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.593s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:52 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d7207b5-09f1-4168-bb90-6082a5529148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2412c9d-1e54-4007-8a34-45472c0541f3', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:52 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b50c5f68-1567-4bc7-ba7e-5cba1a197cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:52 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[59298670-9ab1-407c-9f5a-fd0a6051172d]: (4, 'raw') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-b117eae4-3992-4793-bfdb-b11b757d6c69 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:52 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] Volume volume-b2412c9d-1e54-4007-8a34-45472c0541f3 (b2412c9d-1e54-4007-8a34-45472c0541f3): created successfully Apr 10 10:33:52 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b50c5f68-1567-4bc7-ba7e-5cba1a197cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:52 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] Flow 'volume_create_manager' (8103758d-0563-4428-bd9c-222efb6e53f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:52 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-51c40175-4f88-4338-b908-6e632ba21ba1 tempest-SnapshotsActionsTest-1794961271 None] Created volume successfully. Apr 10 10:33:52 devstack sudo[84376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8 Apr 10 10:33:52 devstack sudo[84376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-680e2f09-85df-46c3-8873-40730e9e3f83 tempest-SnapshotsActionsTest-1794961271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:53 devstack sudo[84376]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-b117eae4-3992-4793-bfdb-b11b757d6c69 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8" returned: 0 in 0.823s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-b117eae4-3992-4793-bfdb-b11b757d6c69 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:53 devstack sudo[84380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8 Apr 10 10:33:53 devstack sudo[84380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:53 devstack sudo[84380]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-b117eae4-3992-4793-bfdb-b11b757d6c69 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8" returned: 1 in 0.658s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-b117eae4-3992-4793-bfdb-b11b757d6c69 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8' failed. Not Retrying. {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:33:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-b117eae4-3992-4793-bfdb-b11b757d6c69 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.523s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-680e2f09-85df-46c3-8873-40730e9e3f83 tempest-SnapshotsActionsTest-1794961271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.941s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:53 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-680e2f09-85df-46c3-8873-40730e9e3f83 tempest-SnapshotsActionsTest-1794961271 None] Creating offline snapshot da305a51-b55b-446f-8967-a30332b12742 of volume b2412c9d-1e54-4007-8a34-45472c0541f3 {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:33:53 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[477407fa-5f82-4869-8aac-e2b0ed3d560f]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-680e2f09-85df-46c3-8873-40730e9e3f83 tempest-SnapshotsActionsTest-1794961271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:54 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-b117eae4-3992-4793-bfdb-b11b757d6c69 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4', 'name': 'volume-8920fde9-05b9-496d-bd36-76ff1fe208c8', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4f926d4a-af2e-4dda-9f70-6804e733498a', 'enforce_multipath': True} {{(pid=81938) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 10 10:33:54 devstack cinder-volume[81938]: INFO cinder.volume.manager [req-4b900f6d-e474-459e-bbf8-e8415e1f63a2 req-b117eae4-3992-4793-bfdb-b11b757d6c69 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] attachment_update completed successfully. Apr 10 10:33:54 devstack sudo[84385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3 Apr 10 10:33:54 devstack sudo[84385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:54 devstack sudo[84385]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-680e2f09-85df-46c3-8873-40730e9e3f83 tempest-SnapshotsActionsTest-1794961271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3" returned: 0 in 0.690s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-680e2f09-85df-46c3-8873-40730e9e3f83 tempest-SnapshotsActionsTest-1794961271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:54 devstack sudo[84390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 1G Apr 10 10:33:54 devstack sudo[84390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:55 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-0e8e51e2-0e9c-4ef2-87f6-1f009807e228 tempest-GroupSnapshotsTest-1740723573 None] Group tempest-GroupSnapshotsTest-Group-2091495656: creating Apr 10 10:33:55 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-0e8e51e2-0e9c-4ef2-87f6-1f009807e228 tempest-GroupSnapshotsTest-1740723573 None] Group tempest-GroupSnapshotsTest-Group-2091495656: created successfully Apr 10 10:33:55 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-0e8e51e2-0e9c-4ef2-87f6-1f009807e228 tempest-GroupSnapshotsTest-1740723573 None] Create group completed successfully. Apr 10 10:33:55 devstack sudo[84390]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-680e2f09-85df-46c3-8873-40730e9e3f83 tempest-SnapshotsActionsTest-1794961271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 1G" returned: 0 in 0.794s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-680e2f09-85df-46c3-8873-40730e9e3f83 tempest-SnapshotsActionsTest-1794961271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2412c9d-1e54-4007-8a34-45472c0541f3 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:55 devstack sudo[84396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2412c9d-1e54-4007-8a34-45472c0541f3 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 Apr 10 10:33:55 devstack sudo[84396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:56 devstack sudo[84396]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-680e2f09-85df-46c3-8873-40730e9e3f83 tempest-SnapshotsActionsTest-1794961271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2412c9d-1e54-4007-8a34-45472c0541f3 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742" returned: 0 in 0.849s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:56 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-680e2f09-85df-46c3-8873-40730e9e3f83 tempest-SnapshotsActionsTest-1794961271 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 is being set with open permissions: ugo+rw Apr 10 10:33:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-680e2f09-85df-46c3-8873-40730e9e3f83 tempest-SnapshotsActionsTest-1794961271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:56 devstack sudo[84435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 Apr 10 10:33:56 devstack sudo[84435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:56 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:33:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] Flow 'volume_create_manager' (897c73b2-654e-4ac1-8e8b-db6d0383c552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68f31594-e4ab-4b99-98cb-a7198fdce044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68f31594-e4ab-4b99-98cb-a7198fdce044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-223269504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=82519f11-d253-42e1-a743-e0520ba2b217,host='devstack@QuobyteHD#QuobyteHD',id=c94935e2-021d-4d7a-b752-01a2736027a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a15dddae0a2549fba50df6f678735c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:57Z,use_quota=True,user_id='bf543574a01342fb8c6fca09afe3370f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(baf3c278-34ee-4869-8b05-ebab2384ad91),volume_type_id=baf3c278-34ee-4869-8b05-ebab2384ad91)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (215b438b-0627-485f-a552-a74b3e9ae12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (215b438b-0627-485f-a552-a74b3e9ae12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (149e7ade-821e-40d4-b105-d92acc8a889a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (149e7ade-821e-40d4-b105-d92acc8a889a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c94935e2-021d-4d7a-b752-01a2736027a6', 'volume_name': 'volume-c94935e2-021d-4d7a-b752-01a2736027a6', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60fb4aa3-13d8-435b-8658-e12d5e10dcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60fb4aa3-13d8-435b-8658-e12d5e10dcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c81ea2-26f3-4ddb-aa3b-b5b935742dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:56 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] Volume c94935e2-021d-4d7a-b752-01a2736027a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c94935e2-021d-4d7a-b752-01a2736027a6', 'volume_size': 1} Apr 10 10:33:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:56 devstack sudo[84435]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-680e2f09-85df-46c3-8873-40730e9e3f83 tempest-SnapshotsActionsTest-1794961271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742" returned: 0 in 0.669s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-680e2f09-85df-46c3-8873-40730e9e3f83 tempest-SnapshotsActionsTest-1794961271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:57 devstack sudo[84438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.info Apr 10 10:33:57 devstack sudo[84438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:57 devstack sudo[84438]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-680e2f09-85df-46c3-8873-40730e9e3f83 tempest-SnapshotsActionsTest-1794961271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.info" returned: 0 in 0.501s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:57 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-680e2f09-85df-46c3-8873-40730e9e3f83 tempest-SnapshotsActionsTest-1794961271 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.info is being set with open permissions: ugo+rw Apr 10 10:33:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-680e2f09-85df-46c3-8873-40730e9e3f83 tempest-SnapshotsActionsTest-1794961271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:57 devstack sudo[84444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.info Apr 10 10:33:57 devstack sudo[84444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:57 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:33:57 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] Flow 'volume_create_manager' (8bea96ea-6b4e-4a06-953c-b4e5a5cfd200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:57 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8b7e3b-f41e-438f-99a2-f18992e3c714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:57 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8b7e3b-f41e-438f-99a2-f18992e3c714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-218469987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a973e1-d956-4148-96d9-83ecf116ac84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e4e6838c3e4eb9a82fd17aeba845d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:58Z,use_quota=True,user_id='8417b83065de4d1a806dceb993bc4fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:57 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28d749d-839e-4232-b414-74c73d7820d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:57 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28d749d-839e-4232-b414-74c73d7820d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:57 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b265a07-2d76-4c6a-bf4a-a545e06a6d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:57 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b265a07-2d76-4c6a-bf4a-a545e06a6d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9a973e1-d956-4148-96d9-83ecf116ac84', 'volume_name': 'volume-f9a973e1-d956-4148-96d9-83ecf116ac84', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:57 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1884ae-5949-4d3c-97c6-523357d924ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:57 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1884ae-5949-4d3c-97c6-523357d924ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:57 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4644a36-d8e4-4513-a27b-ab4e9df35455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:57 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] Volume f9a973e1-d956-4148-96d9-83ecf116ac84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9a973e1-d956-4148-96d9-83ecf116ac84', 'volume_size': 1} Apr 10 10:33:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:58 devstack sudo[84444]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-680e2f09-85df-46c3-8873-40730e9e3f83 tempest-SnapshotsActionsTest-1794961271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.info" returned: 0 in 0.506s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-680e2f09-85df-46c3-8873-40730e9e3f83 tempest-SnapshotsActionsTest-1794961271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.125s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.330s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:58 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=82519f11-d253-42e1-a743-e0520ba2b217,created_at=2026-04-10T08:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-223269504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=82519f11-d253-42e1-a743-e0520ba2b217,host='devstack@QuobyteHD#QuobyteHD',id=c94935e2-021d-4d7a-b752-01a2736027a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a15dddae0a2549fba50df6f678735c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:57Z,use_quota=True,user_id='bf543574a01342fb8c6fca09afe3370f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(baf3c278-34ee-4869-8b05-ebab2384ad91),volume_type_id=baf3c278-34ee-4869-8b05-ebab2384ad91)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:33:58 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] Creating volume c94935e2-021d-4d7a-b752-01a2736027a6 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:33:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:58 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:58 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:58 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:33:58 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:33:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:58 devstack sudo[84447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6 1073741824 Apr 10 10:33:58 devstack sudo[84447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:58 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-680e2f09-85df-46c3-8873-40730e9e3f83 tempest-SnapshotsActionsTest-1794961271 None] Create snapshot completed successfully Apr 10 10:33:58 devstack sudo[84447]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6 1073741824" returned: 0 in 0.749s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:58 devstack sudo[84471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6 Apr 10 10:33:58 devstack sudo[84471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-fd39c4b7-c6e8-427f-af1a-39b0a2b5e672 tempest-SnapshotsActionsTest-1794961271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:59 devstack sudo[84471]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6" returned: 0 in 0.616s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:59 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:33:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.618s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:59 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-218469987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a973e1-d956-4148-96d9-83ecf116ac84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e4e6838c3e4eb9a82fd17aeba845d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:58Z,use_quota=True,user_id='8417b83065de4d1a806dceb993bc4fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:33:59 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] Creating volume f9a973e1-d956-4148-96d9-83ecf116ac84 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:33:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:59 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:59 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:59 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:33:59 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:33:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c81ea2-26f3-4ddb-aa3b-b5b935742dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c94935e2-021d-4d7a-b752-01a2736027a6', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:59 devstack sudo[84479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84 1073741824 Apr 10 10:33:59 devstack sudo[84479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f176d08-4105-4637-8f89-91f6cfa65a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:59 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] Volume volume-c94935e2-021d-4d7a-b752-01a2736027a6 (c94935e2-021d-4d7a-b752-01a2736027a6): created successfully Apr 10 10:33:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f176d08-4105-4637-8f89-91f6cfa65a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] Flow 'volume_create_manager' (897c73b2-654e-4ac1-8e8b-db6d0383c552) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:59 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-bffce805-b1b8-43a2-83e9-d79e5e57e15e tempest-GroupSnapshotsTest-1740723573 None] Created volume successfully. Apr 10 10:34:00 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-89d407bf-c45a-4bb8-b26d-12c5ca1a8457 tempest-GroupSnapshotsTest-1740723573 None] GroupSnapshot 6efed996-77e2-483b-8f18-3c5b13975971: creating. Apr 10 10:34:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-89d407bf-c45a-4bb8-b26d-12c5ca1a8457 tempest-GroupSnapshotsTest-1740723573 None] Group snapshot 6efed996-77e2-483b-8f18-3c5b13975971: creating. {{(pid=81938) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 10 10:34:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-89d407bf-c45a-4bb8-b26d-12c5ca1a8457 tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:00 devstack sudo[84479]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84 1073741824" returned: 0 in 0.801s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:00 devstack sudo[84485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84 Apr 10 10:34:00 devstack sudo[84485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:00 devstack sudo[84485]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84" returned: 0 in 0.461s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:00 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:34:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-fd39c4b7-c6e8-427f-af1a-39b0a2b5e672 tempest-SnapshotsActionsTest-1794961271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.848s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4644a36-d8e4-4513-a27b-ab4e9df35455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9a973e1-d956-4148-96d9-83ecf116ac84', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb168d5b-9778-49bc-914d-00b5426843c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:00 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-fd39c4b7-c6e8-427f-af1a-39b0a2b5e672 tempest-SnapshotsActionsTest-1794961271 None] Creating offline snapshot 05c24bdc-669f-4019-b449-36381df66169 of volume b2412c9d-1e54-4007-8a34-45472c0541f3 {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:34:00 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] Volume volume-f9a973e1-d956-4148-96d9-83ecf116ac84 (f9a973e1-d956-4148-96d9-83ecf116ac84): created successfully Apr 10 10:34:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb168d5b-9778-49bc-914d-00b5426843c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] Flow 'volume_create_manager' (8bea96ea-6b4e-4a06-953c-b4e5a5cfd200) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:00 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68b6147-864c-4b87-a931-0ca77dc1c5dc]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd39c4b7-c6e8-427f-af1a-39b0a2b5e672 tempest-SnapshotsActionsTest-1794961271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:00 devstack cinder-volume[81938]: INFO cinder.volume.manager [req-a3123ddc-2b57-487c-be66-b7f6d8e5410c req-08cfcb0a-ea3f-4eed-b2de-2408fc2eadab tempest-VolumesSnapshotsTestJSON-165917195 None] Created volume successfully. Apr 10 10:34:00 devstack sudo[84494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 Apr 10 10:34:00 devstack sudo[84494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-78bae21c-1d69-4fcd-8ea1-fa1209593f64 req-c4cd679e-ed47-4cc1-bd0f-dd093f3841e3 tempest-VolumesSnapshotsTestJSON-165917195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:01 devstack sudo[84494]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd39c4b7-c6e8-427f-af1a-39b0a2b5e672 tempest-SnapshotsActionsTest-1794961271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742" returned: 0 in 1.184s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:02 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-fd39c4b7-c6e8-427f-af1a-39b0a2b5e672 tempest-SnapshotsActionsTest-1794961271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2412c9d-1e54-4007-8a34-45472c0541f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:34:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd39c4b7-c6e8-427f-af1a-39b0a2b5e672 tempest-SnapshotsActionsTest-1794961271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.05c24bdc-669f-4019-b449-36381df66169 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:02 devstack sudo[84506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.05c24bdc-669f-4019-b449-36381df66169 1G Apr 10 10:34:02 devstack sudo[84506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:02 devstack sudo[84506]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd39c4b7-c6e8-427f-af1a-39b0a2b5e672 tempest-SnapshotsActionsTest-1794961271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.05c24bdc-669f-4019-b449-36381df66169 1G" returned: 0 in 0.649s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd39c4b7-c6e8-427f-af1a-39b0a2b5e672 tempest-SnapshotsActionsTest-1794961271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.05c24bdc-669f-4019-b449-36381df66169 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:02 devstack sudo[84511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.05c24bdc-669f-4019-b449-36381df66169 Apr 10 10:34:02 devstack sudo[84511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:03 devstack sudo[84511]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd39c4b7-c6e8-427f-af1a-39b0a2b5e672 tempest-SnapshotsActionsTest-1794961271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.05c24bdc-669f-4019-b449-36381df66169" returned: 0 in 0.511s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:03 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-fd39c4b7-c6e8-427f-af1a-39b0a2b5e672 tempest-SnapshotsActionsTest-1794961271 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.05c24bdc-669f-4019-b449-36381df66169 is being set with open permissions: ugo+rw Apr 10 10:34:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd39c4b7-c6e8-427f-af1a-39b0a2b5e672 tempest-SnapshotsActionsTest-1794961271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.05c24bdc-669f-4019-b449-36381df66169 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:03 devstack sudo[84516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.05c24bdc-669f-4019-b449-36381df66169 Apr 10 10:34:03 devstack sudo[84516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:03 devstack sudo[84516]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd39c4b7-c6e8-427f-af1a-39b0a2b5e672 tempest-SnapshotsActionsTest-1794961271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.05c24bdc-669f-4019-b449-36381df66169" returned: 0 in 0.713s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-fd39c4b7-c6e8-427f-af1a-39b0a2b5e672 tempest-SnapshotsActionsTest-1794961271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.161s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-89d407bf-c45a-4bb8-b26d-12c5ca1a8457 tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.783s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:03 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-fd39c4b7-c6e8-427f-af1a-39b0a2b5e672 tempest-SnapshotsActionsTest-1794961271 None] Create snapshot completed successfully Apr 10 10:34:03 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-89d407bf-c45a-4bb8-b26d-12c5ca1a8457 tempest-GroupSnapshotsTest-1740723573 None] Creating offline snapshot 4c18519d-11d0-4ffe-a40d-192eb1a2c273 of volume c94935e2-021d-4d7a-b752-01a2736027a6 {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:34:03 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9a7f59-a175-486b-9616-d91b8a8a8a40]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-89d407bf-c45a-4bb8-b26d-12c5ca1a8457 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:04 devstack sudo[84519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6 Apr 10 10:34:04 devstack sudo[84519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:04 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e5af65eb-475f-4875-b73f-b0e53d350c2e tempest-SnapshotsActionsTest-474110311 None] Acquiring lock "cinder-05c24bdc-669f-4019-b449-36381df66169-delete_snapshot" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:04 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e5af65eb-475f-4875-b73f-b0e53d350c2e tempest-SnapshotsActionsTest-474110311 None] Lock "cinder-05c24bdc-669f-4019-b449-36381df66169-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:04 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e5af65eb-475f-4875-b73f-b0e53d350c2e tempest-SnapshotsActionsTest-474110311 None] Acquiring lock "cinder-quobyte-b2412c9d-1e54-4007-8a34-45472c0541f3" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:04 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e5af65eb-475f-4875-b73f-b0e53d350c2e tempest-SnapshotsActionsTest-474110311 None] Lock "cinder-quobyte-b2412c9d-1e54-4007-8a34-45472c0541f3" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:04 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e5af65eb-475f-4875-b73f-b0e53d350c2e tempest-SnapshotsActionsTest-474110311 None] Acquiring lock "cinder-quobyte-05c24bdc-669f-4019-b449-36381df66169" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:04 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e5af65eb-475f-4875-b73f-b0e53d350c2e tempest-SnapshotsActionsTest-474110311 None] Lock "cinder-quobyte-05c24bdc-669f-4019-b449-36381df66169" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:04 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-e5af65eb-475f-4875-b73f-b0e53d350c2e tempest-SnapshotsActionsTest-474110311 None] Deleting offline snapshot 05c24bdc-669f-4019-b449-36381df66169 of volume b2412c9d-1e54-4007-8a34-45472c0541f3 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:34:04 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-e5af65eb-475f-4875-b73f-b0e53d350c2e tempest-SnapshotsActionsTest-474110311 None] snapshot_file for this snap is: volume-b2412c9d-1e54-4007-8a34-45472c0541f3.05c24bdc-669f-4019-b449-36381df66169 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:34:04 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[9042f6cd-065a-4b9f-a2d7-a27f29397d15]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e5af65eb-475f-4875-b73f-b0e53d350c2e tempest-SnapshotsActionsTest-474110311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.05c24bdc-669f-4019-b449-36381df66169 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:04 devstack sudo[84521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.05c24bdc-669f-4019-b449-36381df66169 Apr 10 10:34:04 devstack sudo[84521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:04 devstack sudo[84519]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-89d407bf-c45a-4bb8-b26d-12c5ca1a8457 tempest-GroupSnapshotsTest-1740723573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6" returned: 0 in 0.614s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-89d407bf-c45a-4bb8-b26d-12c5ca1a8457 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6.4c18519d-11d0-4ffe-a40d-192eb1a2c273 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:04 devstack sudo[84526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6.4c18519d-11d0-4ffe-a40d-192eb1a2c273 1G Apr 10 10:34:04 devstack sudo[84526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:05 devstack sudo[84521]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e5af65eb-475f-4875-b73f-b0e53d350c2e tempest-SnapshotsActionsTest-474110311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.05c24bdc-669f-4019-b449-36381df66169" returned: 0 in 0.710s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:05 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-e5af65eb-475f-4875-b73f-b0e53d350c2e tempest-SnapshotsActionsTest-474110311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2412c9d-1e54-4007-8a34-45472c0541f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:34:05 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cac01b-5dcc-49b9-a3c3-6d1d5982e115]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e5af65eb-475f-4875-b73f-b0e53d350c2e tempest-SnapshotsActionsTest-474110311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:05 devstack sudo[84526]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-89d407bf-c45a-4bb8-b26d-12c5ca1a8457 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6.4c18519d-11d0-4ffe-a40d-192eb1a2c273 1G" returned: 0 in 0.619s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-89d407bf-c45a-4bb8-b26d-12c5ca1a8457 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c94935e2-021d-4d7a-b752-01a2736027a6 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6.4c18519d-11d0-4ffe-a40d-192eb1a2c273 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:05 devstack sudo[84534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 Apr 10 10:34:05 devstack sudo[84534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:05 devstack sudo[84535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c94935e2-021d-4d7a-b752-01a2736027a6 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6.4c18519d-11d0-4ffe-a40d-192eb1a2c273 Apr 10 10:34:05 devstack sudo[84535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:05 devstack sudo[84535]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-89d407bf-c45a-4bb8-b26d-12c5ca1a8457 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c94935e2-021d-4d7a-b752-01a2736027a6 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6.4c18519d-11d0-4ffe-a40d-192eb1a2c273" returned: 0 in 0.468s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:05 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-89d407bf-c45a-4bb8-b26d-12c5ca1a8457 tempest-GroupSnapshotsTest-1740723573 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6.4c18519d-11d0-4ffe-a40d-192eb1a2c273 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:34:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-89d407bf-c45a-4bb8-b26d-12c5ca1a8457 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6.4c18519d-11d0-4ffe-a40d-192eb1a2c273 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:05 devstack sudo[84544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6.4c18519d-11d0-4ffe-a40d-192eb1a2c273 Apr 10 10:34:05 devstack sudo[84544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:05 devstack sudo[84534]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e5af65eb-475f-4875-b73f-b0e53d350c2e tempest-SnapshotsActionsTest-474110311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742" returned: 0 in 0.565s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:05 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-e5af65eb-475f-4875-b73f-b0e53d350c2e tempest-SnapshotsActionsTest-474110311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2412c9d-1e54-4007-8a34-45472c0541f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:34:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e5af65eb-475f-4875-b73f-b0e53d350c2e tempest-SnapshotsActionsTest-474110311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.05c24bdc-669f-4019-b449-36381df66169 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:05 devstack sudo[84546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.05c24bdc-669f-4019-b449-36381df66169 Apr 10 10:34:05 devstack sudo[84546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:06 devstack sudo[84544]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-89d407bf-c45a-4bb8-b26d-12c5ca1a8457 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6.4c18519d-11d0-4ffe-a40d-192eb1a2c273" returned: 0 in 0.682s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-89d407bf-c45a-4bb8-b26d-12c5ca1a8457 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:06 devstack sudo[84577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6.info Apr 10 10:34:06 devstack sudo[84577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:06 devstack sudo[84546]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e5af65eb-475f-4875-b73f-b0e53d350c2e tempest-SnapshotsActionsTest-474110311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.05c24bdc-669f-4019-b449-36381df66169" returned: 0 in 0.719s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e5af65eb-475f-4875-b73f-b0e53d350c2e tempest-SnapshotsActionsTest-474110311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.05c24bdc-669f-4019-b449-36381df66169 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:06 devstack sudo[84579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.05c24bdc-669f-4019-b449-36381df66169 Apr 10 10:34:06 devstack sudo[84579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:06 devstack sudo[84577]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-89d407bf-c45a-4bb8-b26d-12c5ca1a8457 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6.info" returned: 0 in 0.469s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:06 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-89d407bf-c45a-4bb8-b26d-12c5ca1a8457 tempest-GroupSnapshotsTest-1740723573 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:34:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-89d407bf-c45a-4bb8-b26d-12c5ca1a8457 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:06 devstack sudo[84583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6.info Apr 10 10:34:06 devstack sudo[84583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:06 devstack sudo[84579]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e5af65eb-475f-4875-b73f-b0e53d350c2e tempest-SnapshotsActionsTest-474110311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.05c24bdc-669f-4019-b449-36381df66169" returned: 0 in 0.454s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:06 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e5af65eb-475f-4875-b73f-b0e53d350c2e tempest-SnapshotsActionsTest-474110311 None] Lock "cinder-quobyte-05c24bdc-669f-4019-b449-36381df66169" released by "_delete_snapshot" :: held 2.511s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:06 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e5af65eb-475f-4875-b73f-b0e53d350c2e tempest-SnapshotsActionsTest-474110311 None] Lock "cinder-quobyte-b2412c9d-1e54-4007-8a34-45472c0541f3" released by "delete_snapshot" :: held 2.526s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:06 devstack cinder-volume[81938]: WARNING cinder.quota [None req-e5af65eb-475f-4875-b73f-b0e53d350c2e tempest-SnapshotsActionsTest-474110311 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:34:06 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-e5af65eb-475f-4875-b73f-b0e53d350c2e tempest-SnapshotsActionsTest-474110311 None] Created reservations ['f445426b-653d-46ce-8dd3-260d72e94966', '8e883f3d-f6a1-4ee1-8b78-96ffdc831c62', 'd360beae-2bde-476e-954b-eadea427de05', 'ec3c9328-ad91-46ae-b9f4-7a481ad6ed01'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:06 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-e5af65eb-475f-4875-b73f-b0e53d350c2e tempest-SnapshotsActionsTest-474110311 None] Delete snapshot completed successfully. Apr 10 10:34:07 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e5af65eb-475f-4875-b73f-b0e53d350c2e tempest-SnapshotsActionsTest-474110311 None] Lock "cinder-05c24bdc-669f-4019-b449-36381df66169-delete_snapshot" released by "delete_snapshot" :: held 2.633s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:07 devstack sudo[84583]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-89d407bf-c45a-4bb8-b26d-12c5ca1a8457 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6.info" returned: 0 in 0.487s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-89d407bf-c45a-4bb8-b26d-12c5ca1a8457 tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.424s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-78bae21c-1d69-4fcd-8ea1-fa1209593f64 req-c4cd679e-ed47-4cc1-bd0f-dd093f3841e3 tempest-VolumesSnapshotsTestJSON-165917195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.848s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [req-78bae21c-1d69-4fcd-8ea1-fa1209593f64 req-c4cd679e-ed47-4cc1-bd0f-dd093f3841e3 tempest-VolumesSnapshotsTestJSON-165917195 None] Creating offline snapshot 15685580-829b-4fb6-8e10-d52ff053bce5 of volume f9a973e1-d956-4148-96d9-83ecf116ac84 {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:34:07 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9540576-c909-414b-8f49-93bbc9e6d45a]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-78bae21c-1d69-4fcd-8ea1-fa1209593f64 req-c4cd679e-ed47-4cc1-bd0f-dd093f3841e3 tempest-VolumesSnapshotsTestJSON-165917195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:07 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-89d407bf-c45a-4bb8-b26d-12c5ca1a8457 tempest-GroupSnapshotsTest-1740723573 None] group_snapshot 6efed996-77e2-483b-8f18-3c5b13975971: created successfully Apr 10 10:34:07 devstack sudo[84587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84 Apr 10 10:34:07 devstack sudo[84587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f4705dd-df98-4827-8659-df6078b15071 tempest-SnapshotsActionsTest-1794961271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:07 devstack sudo[84587]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-78bae21c-1d69-4fcd-8ea1-fa1209593f64 req-c4cd679e-ed47-4cc1-bd0f-dd093f3841e3 tempest-VolumesSnapshotsTestJSON-165917195 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84" returned: 0 in 0.595s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-78bae21c-1d69-4fcd-8ea1-fa1209593f64 req-c4cd679e-ed47-4cc1-bd0f-dd093f3841e3 tempest-VolumesSnapshotsTestJSON-165917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84.15685580-829b-4fb6-8e10-d52ff053bce5 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:07 devstack sudo[84612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84.15685580-829b-4fb6-8e10-d52ff053bce5 1G Apr 10 10:34:07 devstack sudo[84612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:08 devstack sudo[84612]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-78bae21c-1d69-4fcd-8ea1-fa1209593f64 req-c4cd679e-ed47-4cc1-bd0f-dd093f3841e3 tempest-VolumesSnapshotsTestJSON-165917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84.15685580-829b-4fb6-8e10-d52ff053bce5 1G" returned: 0 in 0.512s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-78bae21c-1d69-4fcd-8ea1-fa1209593f64 req-c4cd679e-ed47-4cc1-bd0f-dd093f3841e3 tempest-VolumesSnapshotsTestJSON-165917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9a973e1-d956-4148-96d9-83ecf116ac84 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84.15685580-829b-4fb6-8e10-d52ff053bce5 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:08 devstack sudo[84618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9a973e1-d956-4148-96d9-83ecf116ac84 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84.15685580-829b-4fb6-8e10-d52ff053bce5 Apr 10 10:34:08 devstack sudo[84618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:09 devstack sudo[84618]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-78bae21c-1d69-4fcd-8ea1-fa1209593f64 req-c4cd679e-ed47-4cc1-bd0f-dd093f3841e3 tempest-VolumesSnapshotsTestJSON-165917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9a973e1-d956-4148-96d9-83ecf116ac84 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84.15685580-829b-4fb6-8e10-d52ff053bce5" returned: 0 in 0.529s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:09 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [req-78bae21c-1d69-4fcd-8ea1-fa1209593f64 req-c4cd679e-ed47-4cc1-bd0f-dd093f3841e3 tempest-VolumesSnapshotsTestJSON-165917195 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84.15685580-829b-4fb6-8e10-d52ff053bce5 is being set with open permissions: ugo+rw Apr 10 10:34:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-78bae21c-1d69-4fcd-8ea1-fa1209593f64 req-c4cd679e-ed47-4cc1-bd0f-dd093f3841e3 tempest-VolumesSnapshotsTestJSON-165917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84.15685580-829b-4fb6-8e10-d52ff053bce5 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:09 devstack sudo[84623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84.15685580-829b-4fb6-8e10-d52ff053bce5 Apr 10 10:34:09 devstack sudo[84623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:09 devstack sudo[84623]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-78bae21c-1d69-4fcd-8ea1-fa1209593f64 req-c4cd679e-ed47-4cc1-bd0f-dd093f3841e3 tempest-VolumesSnapshotsTestJSON-165917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84.15685580-829b-4fb6-8e10-d52ff053bce5" returned: 0 in 0.464s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-78bae21c-1d69-4fcd-8ea1-fa1209593f64 req-c4cd679e-ed47-4cc1-bd0f-dd093f3841e3 tempest-VolumesSnapshotsTestJSON-165917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:09 devstack sudo[84626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84.info Apr 10 10:34:09 devstack sudo[84626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:09 devstack sudo[84626]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-78bae21c-1d69-4fcd-8ea1-fa1209593f64 req-c4cd679e-ed47-4cc1-bd0f-dd093f3841e3 tempest-VolumesSnapshotsTestJSON-165917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84.info" returned: 0 in 0.406s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:09 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [req-78bae21c-1d69-4fcd-8ea1-fa1209593f64 req-c4cd679e-ed47-4cc1-bd0f-dd093f3841e3 tempest-VolumesSnapshotsTestJSON-165917195 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84.info is being set with open permissions: ugo+rw Apr 10 10:34:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-78bae21c-1d69-4fcd-8ea1-fa1209593f64 req-c4cd679e-ed47-4cc1-bd0f-dd093f3841e3 tempest-VolumesSnapshotsTestJSON-165917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:09 devstack sudo[84630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84.info Apr 10 10:34:09 devstack sudo[84630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:10 devstack sudo[84630]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-78bae21c-1d69-4fcd-8ea1-fa1209593f64 req-c4cd679e-ed47-4cc1-bd0f-dd093f3841e3 tempest-VolumesSnapshotsTestJSON-165917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84.info" returned: 0 in 0.435s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-78bae21c-1d69-4fcd-8ea1-fa1209593f64 req-c4cd679e-ed47-4cc1-bd0f-dd093f3841e3 tempest-VolumesSnapshotsTestJSON-165917195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.036s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f4705dd-df98-4827-8659-df6078b15071 tempest-SnapshotsActionsTest-1794961271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.441s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:10 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-7f4705dd-df98-4827-8659-df6078b15071 tempest-SnapshotsActionsTest-1794961271 None] Creating offline snapshot ddedd7d5-6431-458b-a9ec-8b6956872de3 of volume b2412c9d-1e54-4007-8a34-45472c0541f3 {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:34:10 devstack cinder-volume[81938]: INFO cinder.volume.manager [req-78bae21c-1d69-4fcd-8ea1-fa1209593f64 req-c4cd679e-ed47-4cc1-bd0f-dd093f3841e3 tempest-VolumesSnapshotsTestJSON-165917195 None] Create snapshot completed successfully Apr 10 10:34:10 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b40e34-f593-43e4-8c57-c1b4e9a41fe7]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f4705dd-df98-4827-8659-df6078b15071 tempest-SnapshotsActionsTest-1794961271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:10 devstack sudo[84633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 Apr 10 10:34:10 devstack sudo[84633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:10 devstack sudo[84633]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f4705dd-df98-4827-8659-df6078b15071 tempest-SnapshotsActionsTest-1794961271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742" returned: 0 in 0.509s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:10 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-7f4705dd-df98-4827-8659-df6078b15071 tempest-SnapshotsActionsTest-1794961271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2412c9d-1e54-4007-8a34-45472c0541f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:34:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f4705dd-df98-4827-8659-df6078b15071 tempest-SnapshotsActionsTest-1794961271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.ddedd7d5-6431-458b-a9ec-8b6956872de3 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:10 devstack sudo[84638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.ddedd7d5-6431-458b-a9ec-8b6956872de3 1G Apr 10 10:34:10 devstack sudo[84638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:11 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-ab192907-1aec-4556-bee9-78702494a5ef req-df8de79c-09fd-4a55-b669-c151f1947ebb tempest-VolumesSnapshotsTestJSON-165917195 None] Acquiring lock "cinder-15685580-829b-4fb6-8e10-d52ff053bce5-delete_snapshot" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:11 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-ab192907-1aec-4556-bee9-78702494a5ef req-df8de79c-09fd-4a55-b669-c151f1947ebb tempest-VolumesSnapshotsTestJSON-165917195 None] Lock "cinder-15685580-829b-4fb6-8e10-d52ff053bce5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:11 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-ab192907-1aec-4556-bee9-78702494a5ef req-df8de79c-09fd-4a55-b669-c151f1947ebb tempest-VolumesSnapshotsTestJSON-165917195 None] Acquiring lock "cinder-quobyte-f9a973e1-d956-4148-96d9-83ecf116ac84" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:11 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-ab192907-1aec-4556-bee9-78702494a5ef req-df8de79c-09fd-4a55-b669-c151f1947ebb tempest-VolumesSnapshotsTestJSON-165917195 None] Lock "cinder-quobyte-f9a973e1-d956-4148-96d9-83ecf116ac84" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:11 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-ab192907-1aec-4556-bee9-78702494a5ef req-df8de79c-09fd-4a55-b669-c151f1947ebb tempest-VolumesSnapshotsTestJSON-165917195 None] Acquiring lock "cinder-quobyte-15685580-829b-4fb6-8e10-d52ff053bce5" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:11 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-ab192907-1aec-4556-bee9-78702494a5ef req-df8de79c-09fd-4a55-b669-c151f1947ebb tempest-VolumesSnapshotsTestJSON-165917195 None] Lock "cinder-quobyte-15685580-829b-4fb6-8e10-d52ff053bce5" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:11 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [req-ab192907-1aec-4556-bee9-78702494a5ef req-df8de79c-09fd-4a55-b669-c151f1947ebb tempest-VolumesSnapshotsTestJSON-165917195 None] Deleting offline snapshot 15685580-829b-4fb6-8e10-d52ff053bce5 of volume f9a973e1-d956-4148-96d9-83ecf116ac84 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:34:11 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [req-ab192907-1aec-4556-bee9-78702494a5ef req-df8de79c-09fd-4a55-b669-c151f1947ebb tempest-VolumesSnapshotsTestJSON-165917195 None] snapshot_file for this snap is: volume-f9a973e1-d956-4148-96d9-83ecf116ac84.15685580-829b-4fb6-8e10-d52ff053bce5 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:34:11 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[558c5dd3-41d6-4c3e-b653-7f0f2a028719]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-ab192907-1aec-4556-bee9-78702494a5ef req-df8de79c-09fd-4a55-b669-c151f1947ebb tempest-VolumesSnapshotsTestJSON-165917195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84.15685580-829b-4fb6-8e10-d52ff053bce5 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:11 devstack sudo[84640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84.15685580-829b-4fb6-8e10-d52ff053bce5 Apr 10 10:34:11 devstack sudo[84640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:11 devstack sudo[84638]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f4705dd-df98-4827-8659-df6078b15071 tempest-SnapshotsActionsTest-1794961271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.ddedd7d5-6431-458b-a9ec-8b6956872de3 1G" returned: 0 in 0.597s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f4705dd-df98-4827-8659-df6078b15071 tempest-SnapshotsActionsTest-1794961271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.ddedd7d5-6431-458b-a9ec-8b6956872de3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:11 devstack sudo[84645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.ddedd7d5-6431-458b-a9ec-8b6956872de3 Apr 10 10:34:11 devstack sudo[84645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:11 devstack sudo[84640]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-ab192907-1aec-4556-bee9-78702494a5ef req-df8de79c-09fd-4a55-b669-c151f1947ebb tempest-VolumesSnapshotsTestJSON-165917195 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84.15685580-829b-4fb6-8e10-d52ff053bce5" returned: 0 in 0.561s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:11 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [req-ab192907-1aec-4556-bee9-78702494a5ef req-df8de79c-09fd-4a55-b669-c151f1947ebb tempest-VolumesSnapshotsTestJSON-165917195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9a973e1-d956-4148-96d9-83ecf116ac84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:34:11 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a66434-79cc-4b52-a9da-c8c340c35f0f]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-ab192907-1aec-4556-bee9-78702494a5ef req-df8de79c-09fd-4a55-b669-c151f1947ebb tempest-VolumesSnapshotsTestJSON-165917195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:11 devstack sudo[84650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84 Apr 10 10:34:11 devstack sudo[84650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:12 devstack sudo[84645]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f4705dd-df98-4827-8659-df6078b15071 tempest-SnapshotsActionsTest-1794961271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.ddedd7d5-6431-458b-a9ec-8b6956872de3" returned: 0 in 0.592s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:12 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-7f4705dd-df98-4827-8659-df6078b15071 tempest-SnapshotsActionsTest-1794961271 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.ddedd7d5-6431-458b-a9ec-8b6956872de3 is being set with open permissions: ugo+rw Apr 10 10:34:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f4705dd-df98-4827-8659-df6078b15071 tempest-SnapshotsActionsTest-1794961271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.ddedd7d5-6431-458b-a9ec-8b6956872de3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:12 devstack sudo[84679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.ddedd7d5-6431-458b-a9ec-8b6956872de3 Apr 10 10:34:12 devstack sudo[84679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:12 devstack sudo[84650]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-ab192907-1aec-4556-bee9-78702494a5ef req-df8de79c-09fd-4a55-b669-c151f1947ebb tempest-VolumesSnapshotsTestJSON-165917195 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84" returned: 0 in 0.663s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-ab192907-1aec-4556-bee9-78702494a5ef req-df8de79c-09fd-4a55-b669-c151f1947ebb tempest-VolumesSnapshotsTestJSON-165917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84.15685580-829b-4fb6-8e10-d52ff053bce5 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:12 devstack sudo[84685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84.15685580-829b-4fb6-8e10-d52ff053bce5 Apr 10 10:34:12 devstack sudo[84685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:12 devstack sudo[84679]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f4705dd-df98-4827-8659-df6078b15071 tempest-SnapshotsActionsTest-1794961271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.ddedd7d5-6431-458b-a9ec-8b6956872de3" returned: 0 in 0.642s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:12 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writing DB stats cinder:UPDATE=71,cinder:SELECT=89,cinder:INSERT=21,cinder:DELETE=3 {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:34:12 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writing DB stats cinder:SELECT=92,cinder:UPDATE=72,cinder:INSERT=23,cinder:DELETE=8 {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:34:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f4705dd-df98-4827-8659-df6078b15071 tempest-SnapshotsActionsTest-1794961271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.437s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.285s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:12 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "cinder-quobyte-4c18519d-11d0-4ffe-a40d-192eb1a2c273-64bdda5d-bb6b-4ff6-83e6-b39462271201" by "_create_volume_from_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:12 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Lock "cinder-quobyte-4c18519d-11d0-4ffe-a40d-192eb1a2c273-64bdda5d-bb6b-4ff6-83e6-b39462271201" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:12 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Creating volume 64bdda5d-bb6b-4ff6-83e6-b39462271201 from snapshot 4c18519d-11d0-4ffe-a40d-192eb1a2c273 {{(pid=81938) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 10:34:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:12 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:12 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:12 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:34:12 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "cinder-quobyte-64bdda5d-bb6b-4ff6-83e6-b39462271201" by "_copy_volume_from_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:12 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-7f4705dd-df98-4827-8659-df6078b15071 tempest-SnapshotsActionsTest-1794961271 None] Create snapshot completed successfully Apr 10 10:34:12 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Lock "cinder-quobyte-64bdda5d-bb6b-4ff6-83e6-b39462271201" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:12 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] snapshot: 4c18519d-11d0-4ffe-a40d-192eb1a2c273, volume: 64bdda5d-bb6b-4ff6-83e6-b39462271201, {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:34:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:12 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:12 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:12 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ada3a3-315b-4e4f-b3a5-9fa07db7d334]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6.4c18519d-11d0-4ffe-a40d-192eb1a2c273 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:13 devstack sudo[84689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6.4c18519d-11d0-4ffe-a40d-192eb1a2c273 Apr 10 10:34:13 devstack sudo[84689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:13 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7409a34d-c93f-4a51-aefa-44b39b27287c tempest-SnapshotsActionsTest-474110311 None] Acquiring lock "cinder-ddedd7d5-6431-458b-a9ec-8b6956872de3-delete_snapshot" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:13 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7409a34d-c93f-4a51-aefa-44b39b27287c tempest-SnapshotsActionsTest-474110311 None] Lock "cinder-ddedd7d5-6431-458b-a9ec-8b6956872de3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:13 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7409a34d-c93f-4a51-aefa-44b39b27287c tempest-SnapshotsActionsTest-474110311 None] Acquiring lock "cinder-quobyte-b2412c9d-1e54-4007-8a34-45472c0541f3" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:13 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7409a34d-c93f-4a51-aefa-44b39b27287c tempest-SnapshotsActionsTest-474110311 None] Lock "cinder-quobyte-b2412c9d-1e54-4007-8a34-45472c0541f3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:13 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7409a34d-c93f-4a51-aefa-44b39b27287c tempest-SnapshotsActionsTest-474110311 None] Acquiring lock "cinder-quobyte-ddedd7d5-6431-458b-a9ec-8b6956872de3" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:13 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7409a34d-c93f-4a51-aefa-44b39b27287c tempest-SnapshotsActionsTest-474110311 None] Lock "cinder-quobyte-ddedd7d5-6431-458b-a9ec-8b6956872de3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:13 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-7409a34d-c93f-4a51-aefa-44b39b27287c tempest-SnapshotsActionsTest-474110311 None] Deleting offline snapshot ddedd7d5-6431-458b-a9ec-8b6956872de3 of volume b2412c9d-1e54-4007-8a34-45472c0541f3 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:34:13 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-7409a34d-c93f-4a51-aefa-44b39b27287c tempest-SnapshotsActionsTest-474110311 None] snapshot_file for this snap is: volume-b2412c9d-1e54-4007-8a34-45472c0541f3.ddedd7d5-6431-458b-a9ec-8b6956872de3 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:34:13 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[be340741-8551-4757-a7d5-4a827b0725bb]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7409a34d-c93f-4a51-aefa-44b39b27287c tempest-SnapshotsActionsTest-474110311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.ddedd7d5-6431-458b-a9ec-8b6956872de3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:13 devstack sudo[84685]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-ab192907-1aec-4556-bee9-78702494a5ef req-df8de79c-09fd-4a55-b669-c151f1947ebb tempest-VolumesSnapshotsTestJSON-165917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84.15685580-829b-4fb6-8e10-d52ff053bce5" returned: 0 in 0.887s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-ab192907-1aec-4556-bee9-78702494a5ef req-df8de79c-09fd-4a55-b669-c151f1947ebb tempest-VolumesSnapshotsTestJSON-165917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84.15685580-829b-4fb6-8e10-d52ff053bce5 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:13 devstack sudo[84695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84.15685580-829b-4fb6-8e10-d52ff053bce5 Apr 10 10:34:13 devstack sudo[84695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:13 devstack sudo[84694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.ddedd7d5-6431-458b-a9ec-8b6956872de3 Apr 10 10:34:13 devstack sudo[84694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:13 devstack sudo[84689]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6.4c18519d-11d0-4ffe-a40d-192eb1a2c273" returned: 0 in 0.646s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:13 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c94935e2-021d-4d7a-b752-01a2736027a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:34:13 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6 {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:34:13 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Creating direct copy from snapshot {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:34:13 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[0989677e-6182-476b-97d3-68450e153e74]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:13 devstack sudo[84701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6 Apr 10 10:34:13 devstack sudo[84701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7409a34d-c93f-4a51-aefa-44b39b27287c tempest-SnapshotsActionsTest-474110311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.ddedd7d5-6431-458b-a9ec-8b6956872de3" returned: 0 in 0.578s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:13 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-7409a34d-c93f-4a51-aefa-44b39b27287c tempest-SnapshotsActionsTest-474110311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2412c9d-1e54-4007-8a34-45472c0541f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:34:13 devstack sudo[84694]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:13 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefcfa54-49b6-4ff4-9c41-c33228c2e9e6]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7409a34d-c93f-4a51-aefa-44b39b27287c tempest-SnapshotsActionsTest-474110311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:13 devstack sudo[84695]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-ab192907-1aec-4556-bee9-78702494a5ef req-df8de79c-09fd-4a55-b669-c151f1947ebb tempest-VolumesSnapshotsTestJSON-165917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84.15685580-829b-4fb6-8e10-d52ff053bce5" returned: 0 in 0.607s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:14 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-ab192907-1aec-4556-bee9-78702494a5ef req-df8de79c-09fd-4a55-b669-c151f1947ebb tempest-VolumesSnapshotsTestJSON-165917195 None] Lock "cinder-quobyte-15685580-829b-4fb6-8e10-d52ff053bce5" released by "_delete_snapshot" :: held 2.802s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:14 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-ab192907-1aec-4556-bee9-78702494a5ef req-df8de79c-09fd-4a55-b669-c151f1947ebb tempest-VolumesSnapshotsTestJSON-165917195 None] Lock "cinder-quobyte-f9a973e1-d956-4148-96d9-83ecf116ac84" released by "delete_snapshot" :: held 2.818s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:14 devstack sudo[84707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 Apr 10 10:34:14 devstack sudo[84707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:14 devstack cinder-volume[81938]: DEBUG cinder.quota [req-ab192907-1aec-4556-bee9-78702494a5ef req-df8de79c-09fd-4a55-b669-c151f1947ebb tempest-VolumesSnapshotsTestJSON-165917195 None] Created reservations ['31ab0704-4193-43be-96da-7957e0f2490f', '65a57cbf-0cc8-4fd3-917f-c66555ed198e', 'f1436bb2-438c-4260-8d78-406f89f62cf3', 'e7a135b4-9ee4-4d3b-8f8b-4b14a31d3e75'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:14 devstack cinder-volume[81938]: INFO cinder.volume.manager [req-ab192907-1aec-4556-bee9-78702494a5ef req-df8de79c-09fd-4a55-b669-c151f1947ebb tempest-VolumesSnapshotsTestJSON-165917195 None] Delete snapshot completed successfully. Apr 10 10:34:14 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-ab192907-1aec-4556-bee9-78702494a5ef req-df8de79c-09fd-4a55-b669-c151f1947ebb tempest-VolumesSnapshotsTestJSON-165917195 None] Lock "cinder-15685580-829b-4fb6-8e10-d52ff053bce5-delete_snapshot" released by "delete_snapshot" :: held 2.960s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:14 devstack sudo[84701]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6" returned: 0 in 0.856s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:14 devstack cinder-volume[81938]: DEBUG cinder.utils [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Path /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-64bdda5d-bb6b-4ff6-83e6-b39462271201 not found in is_blk_device check {{(pid=81938) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:34:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-64bdda5d-bb6b-4ff6-83e6-b39462271201 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:14 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-8f49627a-2078-4b96-bc85-2cdb625039f0 req-0a1c093e-35a2-42d5-951d-27714ccba876 tempest-VolumesSnapshotsTestJSON-165917195 None] Acquiring lock "cinder-f9a973e1-d956-4148-96d9-83ecf116ac84-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:14 devstack sudo[84712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-64bdda5d-bb6b-4ff6-83e6-b39462271201 Apr 10 10:34:14 devstack sudo[84712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:14 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-8f49627a-2078-4b96-bc85-2cdb625039f0 req-0a1c093e-35a2-42d5-951d-27714ccba876 tempest-VolumesSnapshotsTestJSON-165917195 None] Lock "cinder-f9a973e1-d956-4148-96d9-83ecf116ac84-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:14 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-8f49627a-2078-4b96-bc85-2cdb625039f0 req-0a1c093e-35a2-42d5-951d-27714ccba876 tempest-VolumesSnapshotsTestJSON-165917195 None] Acquiring lock "cinder-quobyte-f9a973e1-d956-4148-96d9-83ecf116ac84" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:14 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-8f49627a-2078-4b96-bc85-2cdb625039f0 req-0a1c093e-35a2-42d5-951d-27714ccba876 tempest-VolumesSnapshotsTestJSON-165917195 None] Lock "cinder-quobyte-f9a973e1-d956-4148-96d9-83ecf116ac84" acquired by "delete_volume" :: waited 0.014s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:14 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a0d9ff-70dc-44b1-b8e2-a5d794edfc4f]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-8f49627a-2078-4b96-bc85-2cdb625039f0 req-0a1c093e-35a2-42d5-951d-27714ccba876 tempest-VolumesSnapshotsTestJSON-165917195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:14 devstack sudo[84714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84 Apr 10 10:34:14 devstack sudo[84714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:14 devstack sudo[84707]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7409a34d-c93f-4a51-aefa-44b39b27287c tempest-SnapshotsActionsTest-474110311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742" returned: 0 in 0.759s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:14 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-7409a34d-c93f-4a51-aefa-44b39b27287c tempest-SnapshotsActionsTest-474110311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2412c9d-1e54-4007-8a34-45472c0541f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:34:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7409a34d-c93f-4a51-aefa-44b39b27287c tempest-SnapshotsActionsTest-474110311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.ddedd7d5-6431-458b-a9ec-8b6956872de3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:14 devstack sudo[84719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.ddedd7d5-6431-458b-a9ec-8b6956872de3 Apr 10 10:34:14 devstack sudo[84719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:15 devstack sudo[84714]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-8f49627a-2078-4b96-bc85-2cdb625039f0 req-0a1c093e-35a2-42d5-951d-27714ccba876 tempest-VolumesSnapshotsTestJSON-165917195 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84" returned: 0 in 0.819s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-8f49627a-2078-4b96-bc85-2cdb625039f0 req-0a1c093e-35a2-42d5-951d-27714ccba876 tempest-VolumesSnapshotsTestJSON-165917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:15 devstack sudo[84749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84 Apr 10 10:34:15 devstack sudo[84749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:16 devstack sudo[84719]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7409a34d-c93f-4a51-aefa-44b39b27287c tempest-SnapshotsActionsTest-474110311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.ddedd7d5-6431-458b-a9ec-8b6956872de3" returned: 0 in 1.727s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7409a34d-c93f-4a51-aefa-44b39b27287c tempest-SnapshotsActionsTest-474110311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.ddedd7d5-6431-458b-a9ec-8b6956872de3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:16 devstack sudo[84755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.ddedd7d5-6431-458b-a9ec-8b6956872de3 Apr 10 10:34:16 devstack sudo[84755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:17 devstack sudo[84749]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-8f49627a-2078-4b96-bc85-2cdb625039f0 req-0a1c093e-35a2-42d5-951d-27714ccba876 tempest-VolumesSnapshotsTestJSON-165917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9a973e1-d956-4148-96d9-83ecf116ac84" returned: 0 in 2.079s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:17 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-8f49627a-2078-4b96-bc85-2cdb625039f0 req-0a1c093e-35a2-42d5-951d-27714ccba876 tempest-VolumesSnapshotsTestJSON-165917195 None] Lock "cinder-quobyte-f9a973e1-d956-4148-96d9-83ecf116ac84" released by "delete_volume" :: held 2.944s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:17 devstack cinder-volume[81938]: DEBUG cinder.quota [req-8f49627a-2078-4b96-bc85-2cdb625039f0 req-0a1c093e-35a2-42d5-951d-27714ccba876 tempest-VolumesSnapshotsTestJSON-165917195 None] Created reservations ['558df9b5-e8a1-4c90-a156-baaa703ab8f3', '23a6f466-1eff-4790-a00d-4781c46af3fc', '94870bbd-7c87-4c6f-93c3-162923fabf4b', '7e076297-5969-4af3-988c-e454f8ee98ea'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-8f49627a-2078-4b96-bc85-2cdb625039f0 req-0a1c093e-35a2-42d5-951d-27714ccba876 tempest-VolumesSnapshotsTestJSON-165917195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-8f49627a-2078-4b96-bc85-2cdb625039f0 req-0a1c093e-35a2-42d5-951d-27714ccba876 tempest-VolumesSnapshotsTestJSON-165917195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:17 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [req-8f49627a-2078-4b96-bc85-2cdb625039f0 req-0a1c093e-35a2-42d5-951d-27714ccba876 tempest-VolumesSnapshotsTestJSON-165917195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:17 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [req-8f49627a-2078-4b96-bc85-2cdb625039f0 req-0a1c093e-35a2-42d5-951d-27714ccba876 tempest-VolumesSnapshotsTestJSON-165917195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-8f49627a-2078-4b96-bc85-2cdb625039f0 req-0a1c093e-35a2-42d5-951d-27714ccba876 tempest-VolumesSnapshotsTestJSON-165917195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-8f49627a-2078-4b96-bc85-2cdb625039f0 req-0a1c093e-35a2-42d5-951d-27714ccba876 tempest-VolumesSnapshotsTestJSON-165917195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:17 devstack sudo[84712]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-64bdda5d-bb6b-4ff6-83e6-b39462271201" returned: 0 in 3.320s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:17 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4ab07d-b1b4-48ec-9a04-f554177e8788]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:17 devstack sudo[84759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:34:17 devstack sudo[84759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:17 devstack sudo[84755]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7409a34d-c93f-4a51-aefa-44b39b27287c tempest-SnapshotsActionsTest-474110311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.ddedd7d5-6431-458b-a9ec-8b6956872de3" returned: 0 in 1.445s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:17 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7409a34d-c93f-4a51-aefa-44b39b27287c tempest-SnapshotsActionsTest-474110311 None] Lock "cinder-quobyte-ddedd7d5-6431-458b-a9ec-8b6956872de3" released by "_delete_snapshot" :: held 4.605s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:17 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7409a34d-c93f-4a51-aefa-44b39b27287c tempest-SnapshotsActionsTest-474110311 None] Lock "cinder-quobyte-b2412c9d-1e54-4007-8a34-45472c0541f3" released by "delete_snapshot" :: held 4.628s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:17 devstack sudo[84760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6 Apr 10 10:34:17 devstack sudo[84760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:17 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-7409a34d-c93f-4a51-aefa-44b39b27287c tempest-SnapshotsActionsTest-474110311 None] Created reservations ['b583e43a-ce20-42e2-8229-c4469b1aa451', '5338af0e-3222-4cf5-9c85-6c6307b1d512', 'd3fac0bf-fb3a-4cf1-9b46-d6293fe00b55', '7b47c2b3-c118-4c0f-a65b-6993f31d239f'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:18 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-7409a34d-c93f-4a51-aefa-44b39b27287c tempest-SnapshotsActionsTest-474110311 None] Delete snapshot completed successfully. Apr 10 10:34:18 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7409a34d-c93f-4a51-aefa-44b39b27287c tempest-SnapshotsActionsTest-474110311 None] Lock "cinder-ddedd7d5-6431-458b-a9ec-8b6956872de3-delete_snapshot" released by "delete_snapshot" :: held 4.792s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:18 devstack sudo[84759]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-8f49627a-2078-4b96-bc85-2cdb625039f0 req-0a1c093e-35a2-42d5-951d-27714ccba876 tempest-VolumesSnapshotsTestJSON-165917195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.645s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:18 devstack cinder-volume[81938]: DEBUG cinder.manager [req-8f49627a-2078-4b96-bc85-2cdb625039f0 req-0a1c093e-35a2-42d5-951d-27714ccba876 tempest-VolumesSnapshotsTestJSON-165917195 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:34:18 devstack cinder-volume[81938]: INFO cinder.volume.manager [req-8f49627a-2078-4b96-bc85-2cdb625039f0 req-0a1c093e-35a2-42d5-951d-27714ccba876 tempest-VolumesSnapshotsTestJSON-165917195 None] Deleted volume successfully. Apr 10 10:34:18 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-8f49627a-2078-4b96-bc85-2cdb625039f0 req-0a1c093e-35a2-42d5-951d-27714ccba876 tempest-VolumesSnapshotsTestJSON-165917195 None] Lock "cinder-f9a973e1-d956-4148-96d9-83ecf116ac84-delete_volume" released by "delete_volume" :: held 3.921s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:18 devstack sudo[84760]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6" returned: 0 in 0.965s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:18 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6, size 1024.00 MB, duration 3.32 sec, destination /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-64bdda5d-bb6b-4ff6-83e6-b39462271201 {{(pid=81938) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:34:18 devstack cinder-volume[81938]: INFO cinder.image.image_utils [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Converted 1024.00 MB image at 308.19 MB/s Apr 10 10:34:18 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-64bdda5d-bb6b-4ff6-83e6-b39462271201 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:34:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-64bdda5d-bb6b-4ff6-83e6-b39462271201 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:18 devstack sudo[84807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-64bdda5d-bb6b-4ff6-83e6-b39462271201 Apr 10 10:34:18 devstack sudo[84807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-47e4cac5-0d28-4e67-a2cd-3878ad214bc6 tempest-SnapshotsActionsTest-1794961271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:19 devstack sudo[84807]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-64bdda5d-bb6b-4ff6-83e6-b39462271201" returned: 0 in 0.969s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:19 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Lock "cinder-quobyte-64bdda5d-bb6b-4ff6-83e6-b39462271201" released by "_copy_volume_from_snapshot" :: held 6.848s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:19 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Lock "cinder-quobyte-4c18519d-11d0-4ffe-a40d-192eb1a2c273-64bdda5d-bb6b-4ff6-83e6-b39462271201" released by "_create_volume_from_snapshot" :: held 6.892s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.924s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-47e4cac5-0d28-4e67-a2cd-3878ad214bc6 tempest-SnapshotsActionsTest-1794961271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.463s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:19 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-47e4cac5-0d28-4e67-a2cd-3878ad214bc6 tempest-SnapshotsActionsTest-1794961271 None] Creating offline snapshot 1b8942ac-aa8f-4bba-9cc1-c8c0a1d67e34 of volume b2412c9d-1e54-4007-8a34-45472c0541f3 {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:34:19 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ac56f5-9fdf-4c2d-845a-4dfb8c14aba1]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-47e4cac5-0d28-4e67-a2cd-3878ad214bc6 tempest-SnapshotsActionsTest-1794961271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:19 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-6a26ad5a-90f8-40bc-9e66-99fce8b73147 tempest-GroupSnapshotsTest-1740723573 None] Create group from source-snapshot-6efed996-77e2-483b-8f18-3c5b13975971 completed successfully. Apr 10 10:34:19 devstack sudo[84815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 Apr 10 10:34:19 devstack sudo[84815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:20 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-21771479-1d22-4581-b244-1e05d628bdac tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "cinder-quobyte-64bdda5d-bb6b-4ff6-83e6-b39462271201" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:20 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-21771479-1d22-4581-b244-1e05d628bdac tempest-GroupSnapshotsTest-1740723573 None] Lock "cinder-quobyte-64bdda5d-bb6b-4ff6-83e6-b39462271201" acquired by "delete_volume" :: waited 0.018s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:20 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d396094-0f65-443b-9c5f-563cba61900c]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-21771479-1d22-4581-b244-1e05d628bdac tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-64bdda5d-bb6b-4ff6-83e6-b39462271201 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:20 devstack sudo[84821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-64bdda5d-bb6b-4ff6-83e6-b39462271201 Apr 10 10:34:20 devstack sudo[84821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:20 devstack sudo[84815]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-47e4cac5-0d28-4e67-a2cd-3878ad214bc6 tempest-SnapshotsActionsTest-1794961271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742" returned: 0 in 1.056s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:20 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-47e4cac5-0d28-4e67-a2cd-3878ad214bc6 tempest-SnapshotsActionsTest-1794961271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2412c9d-1e54-4007-8a34-45472c0541f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:34:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-47e4cac5-0d28-4e67-a2cd-3878ad214bc6 tempest-SnapshotsActionsTest-1794961271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.1b8942ac-aa8f-4bba-9cc1-c8c0a1d67e34 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:20 devstack sudo[84823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.1b8942ac-aa8f-4bba-9cc1-c8c0a1d67e34 1G Apr 10 10:34:20 devstack sudo[84823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:21 devstack sudo[84821]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-21771479-1d22-4581-b244-1e05d628bdac tempest-GroupSnapshotsTest-1740723573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-64bdda5d-bb6b-4ff6-83e6-b39462271201" returned: 0 in 0.972s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-21771479-1d22-4581-b244-1e05d628bdac tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-64bdda5d-bb6b-4ff6-83e6-b39462271201 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:21 devstack sudo[84828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-64bdda5d-bb6b-4ff6-83e6-b39462271201 Apr 10 10:34:21 devstack sudo[84828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:22 devstack sudo[84823]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-47e4cac5-0d28-4e67-a2cd-3878ad214bc6 tempest-SnapshotsActionsTest-1794961271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.1b8942ac-aa8f-4bba-9cc1-c8c0a1d67e34 1G" returned: 0 in 1.264s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-47e4cac5-0d28-4e67-a2cd-3878ad214bc6 tempest-SnapshotsActionsTest-1794961271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.1b8942ac-aa8f-4bba-9cc1-c8c0a1d67e34 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:22 devstack sudo[84833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.1b8942ac-aa8f-4bba-9cc1-c8c0a1d67e34 Apr 10 10:34:22 devstack sudo[84833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:22 devstack sudo[84828]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-21771479-1d22-4581-b244-1e05d628bdac tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-64bdda5d-bb6b-4ff6-83e6-b39462271201" returned: 0 in 0.631s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:22 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-21771479-1d22-4581-b244-1e05d628bdac tempest-GroupSnapshotsTest-1740723573 None] Lock "cinder-quobyte-64bdda5d-bb6b-4ff6-83e6-b39462271201" released by "delete_volume" :: held 1.649s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:22 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-21771479-1d22-4581-b244-1e05d628bdac tempest-GroupSnapshotsTest-1740723573 None] Created reservations ['1e3d6477-6b34-4051-ab34-858ba328f51d'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:22 devstack cinder-volume[81938]: WARNING cinder.quota [None req-21771479-1d22-4581-b244-1e05d628bdac tempest-GroupSnapshotsTest-1740723573 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1620251213 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1620251213, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:34:22 devstack cinder-volume[81938]: WARNING cinder.quota [None req-21771479-1d22-4581-b244-1e05d628bdac tempest-GroupSnapshotsTest-1740723573 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1620251213 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1620251213, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:34:22 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-21771479-1d22-4581-b244-1e05d628bdac tempest-GroupSnapshotsTest-1740723573 None] Created reservations ['6fcd86de-9981-4dc5-bbf7-34931403369a', 'cafbf14d-faf9-4fdb-a5d7-86249b9710de', '2a16d8c0-799a-47eb-931f-ad4b667b4cd2', '3486307f-5eb5-432b-be92-6243db3f819b'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-21771479-1d22-4581-b244-1e05d628bdac tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-21771479-1d22-4581-b244-1e05d628bdac tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-21771479-1d22-4581-b244-1e05d628bdac tempest-GroupSnapshotsTest-1740723573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-21771479-1d22-4581-b244-1e05d628bdac tempest-GroupSnapshotsTest-1740723573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-21771479-1d22-4581-b244-1e05d628bdac tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-21771479-1d22-4581-b244-1e05d628bdac tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:22 devstack sudo[84843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:34:22 devstack sudo[84843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:22 devstack sudo[84833]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-47e4cac5-0d28-4e67-a2cd-3878ad214bc6 tempest-SnapshotsActionsTest-1794961271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.1b8942ac-aa8f-4bba-9cc1-c8c0a1d67e34" returned: 0 in 0.681s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:22 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-47e4cac5-0d28-4e67-a2cd-3878ad214bc6 tempest-SnapshotsActionsTest-1794961271 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.1b8942ac-aa8f-4bba-9cc1-c8c0a1d67e34 is being set with open permissions: ugo+rw Apr 10 10:34:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-47e4cac5-0d28-4e67-a2cd-3878ad214bc6 tempest-SnapshotsActionsTest-1794961271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.1b8942ac-aa8f-4bba-9cc1-c8c0a1d67e34 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:22 devstack sudo[84865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.1b8942ac-aa8f-4bba-9cc1-c8c0a1d67e34 Apr 10 10:34:22 devstack sudo[84865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:23 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-1bbcd686-a2a6-4908-9a32-beba0d5dfe80 tempest-GroupSnapshotsTest-1740723573 None] group_snapshot 6efed996-77e2-483b-8f18-3c5b13975971: deleting Apr 10 10:34:23 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1bbcd686-a2a6-4908-9a32-beba0d5dfe80 tempest-GroupSnapshotsTest-1740723573 None] group_snapshot 6efed996-77e2-483b-8f18-3c5b13975971: deleting {{(pid=81938) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 10 10:34:23 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-1bbcd686-a2a6-4908-9a32-beba0d5dfe80 tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "cinder-quobyte-c94935e2-021d-4d7a-b752-01a2736027a6" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:23 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-1bbcd686-a2a6-4908-9a32-beba0d5dfe80 tempest-GroupSnapshotsTest-1740723573 None] Lock "cinder-quobyte-c94935e2-021d-4d7a-b752-01a2736027a6" acquired by "delete_snapshot" :: waited 0.058s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:23 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-1bbcd686-a2a6-4908-9a32-beba0d5dfe80 tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "cinder-quobyte-4c18519d-11d0-4ffe-a40d-192eb1a2c273" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:23 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-321fb9a7-149e-4d58-a934-fdbb49c7bae9 tempest-GroupsTest-1301316427 None] Group tempest-Group1-596980159: creating Apr 10 10:34:23 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-1bbcd686-a2a6-4908-9a32-beba0d5dfe80 tempest-GroupSnapshotsTest-1740723573 None] Lock "cinder-quobyte-4c18519d-11d0-4ffe-a40d-192eb1a2c273" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:23 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-1bbcd686-a2a6-4908-9a32-beba0d5dfe80 tempest-GroupSnapshotsTest-1740723573 None] Deleting offline snapshot 4c18519d-11d0-4ffe-a40d-192eb1a2c273 of volume c94935e2-021d-4d7a-b752-01a2736027a6 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:34:23 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-1bbcd686-a2a6-4908-9a32-beba0d5dfe80 tempest-GroupSnapshotsTest-1740723573 None] snapshot_file for this snap is: volume-c94935e2-021d-4d7a-b752-01a2736027a6.4c18519d-11d0-4ffe-a40d-192eb1a2c273 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:34:23 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5c74a5-164a-4196-a3c1-8b8cbd74cb57]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:23 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-321fb9a7-149e-4d58-a934-fdbb49c7bae9 tempest-GroupsTest-1301316427 None] Group tempest-Group1-596980159: created successfully Apr 10 10:34:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1bbcd686-a2a6-4908-9a32-beba0d5dfe80 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6.4c18519d-11d0-4ffe-a40d-192eb1a2c273 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:23 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-321fb9a7-149e-4d58-a934-fdbb49c7bae9 tempest-GroupsTest-1301316427 None] Create group completed successfully. Apr 10 10:34:23 devstack sudo[84843]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-21771479-1d22-4581-b244-1e05d628bdac tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.791s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:23 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-21771479-1d22-4581-b244-1e05d628bdac tempest-GroupSnapshotsTest-1740723573 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:34:23 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-21771479-1d22-4581-b244-1e05d628bdac tempest-GroupSnapshotsTest-1740723573 None] Delete group completed successfully. Apr 10 10:34:23 devstack sudo[84870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6.4c18519d-11d0-4ffe-a40d-192eb1a2c273 Apr 10 10:34:23 devstack sudo[84870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:23 devstack sudo[84865]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-47e4cac5-0d28-4e67-a2cd-3878ad214bc6 tempest-SnapshotsActionsTest-1794961271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.1b8942ac-aa8f-4bba-9cc1-c8c0a1d67e34" returned: 0 in 0.706s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-47e4cac5-0d28-4e67-a2cd-3878ad214bc6 tempest-SnapshotsActionsTest-1794961271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.789s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:23 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-47e4cac5-0d28-4e67-a2cd-3878ad214bc6 tempest-SnapshotsActionsTest-1794961271 None] Create snapshot completed successfully Apr 10 10:34:23 devstack sudo[84870]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1bbcd686-a2a6-4908-9a32-beba0d5dfe80 tempest-GroupSnapshotsTest-1740723573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6.4c18519d-11d0-4ffe-a40d-192eb1a2c273" returned: 0 in 0.558s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:23 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-1bbcd686-a2a6-4908-9a32-beba0d5dfe80 tempest-GroupSnapshotsTest-1740723573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c94935e2-021d-4d7a-b752-01a2736027a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:34:23 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[24088fed-3592-45dd-a6e9-1c3e1fa0eb8f]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1bbcd686-a2a6-4908-9a32-beba0d5dfe80 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:23 devstack sudo[84876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6 Apr 10 10:34:23 devstack sudo[84876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:24 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-84a5e1d8-e0a2-485d-993c-37f6d4082333 tempest-GroupsTest-1301316427 None] Group tempest-Group2-1027204291: creating Apr 10 10:34:24 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-84a5e1d8-e0a2-485d-993c-37f6d4082333 tempest-GroupsTest-1301316427 None] Group tempest-Group2-1027204291: created successfully Apr 10 10:34:24 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-84a5e1d8-e0a2-485d-993c-37f6d4082333 tempest-GroupsTest-1301316427 None] Create group completed successfully. Apr 10 10:34:24 devstack sudo[84876]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1bbcd686-a2a6-4908-9a32-beba0d5dfe80 tempest-GroupSnapshotsTest-1740723573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6" returned: 0 in 0.629s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1bbcd686-a2a6-4908-9a32-beba0d5dfe80 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6.4c18519d-11d0-4ffe-a40d-192eb1a2c273 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:24 devstack sudo[84882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6.4c18519d-11d0-4ffe-a40d-192eb1a2c273 Apr 10 10:34:24 devstack sudo[84882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:24 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-392f5e6c-72e7-4603-a004-409046a047f1 tempest-SnapshotsActionsTest-474110311 None] Acquiring lock "cinder-1b8942ac-aa8f-4bba-9cc1-c8c0a1d67e34-delete_snapshot" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:24 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-392f5e6c-72e7-4603-a004-409046a047f1 tempest-SnapshotsActionsTest-474110311 None] Lock "cinder-1b8942ac-aa8f-4bba-9cc1-c8c0a1d67e34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:24 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-392f5e6c-72e7-4603-a004-409046a047f1 tempest-SnapshotsActionsTest-474110311 None] Acquiring lock "cinder-quobyte-b2412c9d-1e54-4007-8a34-45472c0541f3" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:24 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-392f5e6c-72e7-4603-a004-409046a047f1 tempest-SnapshotsActionsTest-474110311 None] Lock "cinder-quobyte-b2412c9d-1e54-4007-8a34-45472c0541f3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:24 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-392f5e6c-72e7-4603-a004-409046a047f1 tempest-SnapshotsActionsTest-474110311 None] Acquiring lock "cinder-quobyte-1b8942ac-aa8f-4bba-9cc1-c8c0a1d67e34" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:24 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-392f5e6c-72e7-4603-a004-409046a047f1 tempest-SnapshotsActionsTest-474110311 None] Lock "cinder-quobyte-1b8942ac-aa8f-4bba-9cc1-c8c0a1d67e34" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:24 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-392f5e6c-72e7-4603-a004-409046a047f1 tempest-SnapshotsActionsTest-474110311 None] Deleting offline snapshot 1b8942ac-aa8f-4bba-9cc1-c8c0a1d67e34 of volume b2412c9d-1e54-4007-8a34-45472c0541f3 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:34:24 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-392f5e6c-72e7-4603-a004-409046a047f1 tempest-SnapshotsActionsTest-474110311 None] snapshot_file for this snap is: volume-b2412c9d-1e54-4007-8a34-45472c0541f3.1b8942ac-aa8f-4bba-9cc1-c8c0a1d67e34 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:34:24 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef90963-89c8-4d01-b9a3-c0ec2c2f666c]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-392f5e6c-72e7-4603-a004-409046a047f1 tempest-SnapshotsActionsTest-474110311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.1b8942ac-aa8f-4bba-9cc1-c8c0a1d67e34 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:24 devstack sudo[84884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.1b8942ac-aa8f-4bba-9cc1-c8c0a1d67e34 Apr 10 10:34:24 devstack sudo[84884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:25 devstack sudo[84882]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1bbcd686-a2a6-4908-9a32-beba0d5dfe80 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6.4c18519d-11d0-4ffe-a40d-192eb1a2c273" returned: 0 in 0.584s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1bbcd686-a2a6-4908-9a32-beba0d5dfe80 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6.4c18519d-11d0-4ffe-a40d-192eb1a2c273 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:25 devstack sudo[84889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6.4c18519d-11d0-4ffe-a40d-192eb1a2c273 Apr 10 10:34:25 devstack sudo[84889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:25 devstack cinder-volume[81938]: INFO cinder.volume.manager [req-fbf741bb-5307-4405-9076-b5f0dbe48075 req-7cf1c288-aad5-4ade-bf5b-48f0faf71883 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Terminate volume connection completed successfully. Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-fbf741bb-5307-4405-9076-b5f0dbe48075 req-7cf1c288-aad5-4ade-bf5b-48f0faf71883 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Deleting attachment 4f926d4a-af2e-4dda-9f70-6804e733498a. {{(pid=81938) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 10 10:34:25 devstack sudo[84884]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-392f5e6c-72e7-4603-a004-409046a047f1 tempest-SnapshotsActionsTest-474110311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.1b8942ac-aa8f-4bba-9cc1-c8c0a1d67e34" returned: 0 in 0.541s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-392f5e6c-72e7-4603-a004-409046a047f1 tempest-SnapshotsActionsTest-474110311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2412c9d-1e54-4007-8a34-45472c0541f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a1eb97-eb03-44ca-8dfb-2939a8d09841]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-392f5e6c-72e7-4603-a004-409046a047f1 tempest-SnapshotsActionsTest-474110311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:25 devstack sudo[84894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 Apr 10 10:34:25 devstack sudo[84894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:34:25 devstack sudo[84889]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] Flow 'volume_create_manager' (4e2e0c03-8632-498d-980e-c374f92aebb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c3db400-f06c-4beb-b074-1db8db99574d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1bbcd686-a2a6-4908-9a32-beba0d5dfe80 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6.4c18519d-11d0-4ffe-a40d-192eb1a2c273" returned: 0 in 0.670s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c3db400-f06c-4beb-b074-1db8db99574d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-145019015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=88446241-bf09-4562-a5bb-5210ab49010b,host='devstack@QuobyteHD#QuobyteHD',id=875f42c9-f633-4bef-af76-da0738dec648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='274e3a06d911446486afc4c741461782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:26Z,use_quota=True,user_id='6a67f4234bcc4b0c9cd0d7412ec6f47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccaa1288-09a1-4ba8-b332-b7e7d5cd62e9),volume_type_id=ccaa1288-09a1-4ba8-b332-b7e7d5cd62e9)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90250d0-985b-463f-8fbf-5860ebf490e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90250d0-985b-463f-8fbf-5860ebf490e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc46cd4-9e04-4218-834c-6db49fdb228f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc46cd4-9e04-4218-834c-6db49fdb228f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '875f42c9-f633-4bef-af76-da0738dec648', 'volume_name': 'volume-875f42c9-f633-4bef-af76-da0738dec648', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d91046-6fed-4bdf-9881-0dec2b1a787f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d91046-6fed-4bdf-9881-0dec2b1a787f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cb07ffc-486d-426e-aafd-7ccfceafe66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:25 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] Volume 875f42c9-f633-4bef-af76-da0738dec648: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-875f42c9-f633-4bef-af76-da0738dec648', 'volume_size': 1} Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=88446241-bf09-4562-a5bb-5210ab49010b,created_at=2026-04-10T08:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-145019015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=88446241-bf09-4562-a5bb-5210ab49010b,host='devstack@QuobyteHD#QuobyteHD',id=875f42c9-f633-4bef-af76-da0738dec648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='274e3a06d911446486afc4c741461782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:26Z,use_quota=True,user_id='6a67f4234bcc4b0c9cd0d7412ec6f47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccaa1288-09a1-4ba8-b332-b7e7d5cd62e9),volume_type_id=ccaa1288-09a1-4ba8-b332-b7e7d5cd62e9)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] Creating volume 875f42c9-f633-4bef-af76-da0738dec648 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:34:25 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-875f42c9-f633-4bef-af76-da0738dec648 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-1bbcd686-a2a6-4908-9a32-beba0d5dfe80 tempest-GroupSnapshotsTest-1740723573 None] Lock "cinder-quobyte-4c18519d-11d0-4ffe-a40d-192eb1a2c273" released by "_delete_snapshot" :: held 2.579s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:25 devstack sudo[84894]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-1bbcd686-a2a6-4908-9a32-beba0d5dfe80 tempest-GroupSnapshotsTest-1740723573 None] Lock "cinder-quobyte-c94935e2-021d-4d7a-b752-01a2736027a6" released by "delete_snapshot" :: held 2.612s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-392f5e6c-72e7-4603-a004-409046a047f1 tempest-SnapshotsActionsTest-474110311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742" returned: 0 in 0.579s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-392f5e6c-72e7-4603-a004-409046a047f1 tempest-SnapshotsActionsTest-474110311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2412c9d-1e54-4007-8a34-45472c0541f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:34:25 devstack sudo[84900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-875f42c9-f633-4bef-af76-da0738dec648 1073741824 Apr 10 10:34:25 devstack sudo[84900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-392f5e6c-72e7-4603-a004-409046a047f1 tempest-SnapshotsActionsTest-474110311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.1b8942ac-aa8f-4bba-9cc1-c8c0a1d67e34 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:25 devstack sudo[84902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.1b8942ac-aa8f-4bba-9cc1-c8c0a1d67e34 Apr 10 10:34:25 devstack sudo[84902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-fbf741bb-5307-4405-9076-b5f0dbe48075 req-0aeb28a3-84d2-4679-8a1a-8c93e32a57a9 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Acquiring lock "cinder-8920fde9-05b9-496d-bd36-76ff1fe208c8-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-fbf741bb-5307-4405-9076-b5f0dbe48075 req-0aeb28a3-84d2-4679-8a1a-8c93e32a57a9 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Lock "cinder-8920fde9-05b9-496d-bd36-76ff1fe208c8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:25 devstack cinder-volume[81938]: WARNING cinder.quota [None req-1bbcd686-a2a6-4908-9a32-beba0d5dfe80 tempest-GroupSnapshotsTest-1740723573 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1620251213 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1620251213, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-fbf741bb-5307-4405-9076-b5f0dbe48075 req-0aeb28a3-84d2-4679-8a1a-8c93e32a57a9 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Acquiring lock "cinder-quobyte-8920fde9-05b9-496d-bd36-76ff1fe208c8" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-1bbcd686-a2a6-4908-9a32-beba0d5dfe80 tempest-GroupSnapshotsTest-1740723573 None] Created reservations ['4e00d7d1-63af-47e8-8939-ce6235952d09', '44f724f2-7e4f-42c3-ace0-960c0fcb807b', '1221e968-e880-4f37-900c-7fc584bcc424', '46def374-f19b-4e7f-9139-e6354f90aef8'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-fbf741bb-5307-4405-9076-b5f0dbe48075 req-0aeb28a3-84d2-4679-8a1a-8c93e32a57a9 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Lock "cinder-quobyte-8920fde9-05b9-496d-bd36-76ff1fe208c8" acquired by "delete_volume" :: waited 0.016s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:26 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e7384a-0ce0-441c-b7aa-3c1b8405f503]: (4, 'raw') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-fbf741bb-5307-4405-9076-b5f0dbe48075 req-0aeb28a3-84d2-4679-8a1a-8c93e32a57a9 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:26 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-1bbcd686-a2a6-4908-9a32-beba0d5dfe80 tempest-GroupSnapshotsTest-1740723573 None] group_snapshot 6efed996-77e2-483b-8f18-3c5b13975971: deleted successfully Apr 10 10:34:26 devstack sudo[84904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8 Apr 10 10:34:26 devstack sudo[84904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:26 devstack sudo[84900]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-875f42c9-f633-4bef-af76-da0738dec648 1073741824" returned: 0 in 0.685s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-875f42c9-f633-4bef-af76-da0738dec648 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:26 devstack sudo[84913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-875f42c9-f633-4bef-af76-da0738dec648 Apr 10 10:34:26 devstack sudo[84913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:26 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-acd17f48-8c25-462a-a5d6-58d0fa7a705e tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "cinder-quobyte-c94935e2-021d-4d7a-b752-01a2736027a6" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:26 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-acd17f48-8c25-462a-a5d6-58d0fa7a705e tempest-GroupSnapshotsTest-1740723573 None] Lock "cinder-quobyte-c94935e2-021d-4d7a-b752-01a2736027a6" acquired by "delete_volume" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:26 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2561322-37bd-4d18-ba8a-ce5101b3540a]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-acd17f48-8c25-462a-a5d6-58d0fa7a705e tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:26 devstack sudo[84902]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-392f5e6c-72e7-4603-a004-409046a047f1 tempest-SnapshotsActionsTest-474110311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.1b8942ac-aa8f-4bba-9cc1-c8c0a1d67e34" returned: 0 in 0.847s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-392f5e6c-72e7-4603-a004-409046a047f1 tempest-SnapshotsActionsTest-474110311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.1b8942ac-aa8f-4bba-9cc1-c8c0a1d67e34 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:26 devstack sudo[84917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.1b8942ac-aa8f-4bba-9cc1-c8c0a1d67e34 Apr 10 10:34:26 devstack sudo[84917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:26 devstack sudo[84904]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-fbf741bb-5307-4405-9076-b5f0dbe48075 req-0aeb28a3-84d2-4679-8a1a-8c93e32a57a9 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8" returned: 0 in 0.727s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-fbf741bb-5307-4405-9076-b5f0dbe48075 req-0aeb28a3-84d2-4679-8a1a-8c93e32a57a9 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:26 devstack sudo[84916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6 Apr 10 10:34:26 devstack sudo[84916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:26 devstack sudo[84919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8 Apr 10 10:34:26 devstack sudo[84919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:27 devstack sudo[84913]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-875f42c9-f633-4bef-af76-da0738dec648" returned: 0 in 0.609s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:27 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:34:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.347s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cb07ffc-486d-426e-aafd-7ccfceafe66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-875f42c9-f633-4bef-af76-da0738dec648', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012622d8-2a77-4dd7-9a8c-6895e4f4ab10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:27 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] Volume volume-875f42c9-f633-4bef-af76-da0738dec648 (875f42c9-f633-4bef-af76-da0738dec648): created successfully Apr 10 10:34:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012622d8-2a77-4dd7-9a8c-6895e4f4ab10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] Flow 'volume_create_manager' (4e2e0c03-8632-498d-980e-c374f92aebb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:27 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-62d36202-65e1-47ac-8d99-a3c337f4a965 tempest-GroupsTest-1301316427 None] Created volume successfully. Apr 10 10:34:27 devstack sudo[84916]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-acd17f48-8c25-462a-a5d6-58d0fa7a705e tempest-GroupSnapshotsTest-1740723573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6" returned: 0 in 0.624s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-acd17f48-8c25-462a-a5d6-58d0fa7a705e tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:27 devstack sudo[84930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6 Apr 10 10:34:27 devstack sudo[84930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:27 devstack sudo[84917]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:27 devstack sudo[84919]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-392f5e6c-72e7-4603-a004-409046a047f1 tempest-SnapshotsActionsTest-474110311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.1b8942ac-aa8f-4bba-9cc1-c8c0a1d67e34" returned: 0 in 0.638s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-fbf741bb-5307-4405-9076-b5f0dbe48075 req-0aeb28a3-84d2-4679-8a1a-8c93e32a57a9 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8" returned: 1 in 0.604s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-fbf741bb-5307-4405-9076-b5f0dbe48075 req-0aeb28a3-84d2-4679-8a1a-8c93e32a57a9 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8' failed. Not Retrying. {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:34:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-fbf741bb-5307-4405-9076-b5f0dbe48075 req-0aeb28a3-84d2-4679-8a1a-8c93e32a57a9 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:27 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-392f5e6c-72e7-4603-a004-409046a047f1 tempest-SnapshotsActionsTest-474110311 None] Lock "cinder-quobyte-1b8942ac-aa8f-4bba-9cc1-c8c0a1d67e34" released by "_delete_snapshot" :: held 2.691s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:27 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-392f5e6c-72e7-4603-a004-409046a047f1 tempest-SnapshotsActionsTest-474110311 None] Lock "cinder-quobyte-b2412c9d-1e54-4007-8a34-45472c0541f3" released by "delete_snapshot" :: held 2.707s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:27 devstack sudo[84932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8 Apr 10 10:34:27 devstack sudo[84932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:27 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-392f5e6c-72e7-4603-a004-409046a047f1 tempest-SnapshotsActionsTest-474110311 None] Created reservations ['7991653b-cec7-4333-83d0-d15a5bdcbfb2', 'cbded1d1-d3ff-4e2d-9d28-a6acb5cfbd1a', '2720089a-f10f-46ae-9518-a0b5abed1ebf', 'a9b9403e-1f54-4cf8-8677-06eb1d6bd935'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:27 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-392f5e6c-72e7-4603-a004-409046a047f1 tempest-SnapshotsActionsTest-474110311 None] Delete snapshot completed successfully. Apr 10 10:34:27 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-392f5e6c-72e7-4603-a004-409046a047f1 tempest-SnapshotsActionsTest-474110311 None] Lock "cinder-1b8942ac-aa8f-4bba-9cc1-c8c0a1d67e34-delete_snapshot" released by "delete_snapshot" :: held 2.832s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:27 devstack sudo[84930]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-acd17f48-8c25-462a-a5d6-58d0fa7a705e tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c94935e2-021d-4d7a-b752-01a2736027a6" returned: 0 in 0.513s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:27 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-acd17f48-8c25-462a-a5d6-58d0fa7a705e tempest-GroupSnapshotsTest-1740723573 None] Lock "cinder-quobyte-c94935e2-021d-4d7a-b752-01a2736027a6" released by "delete_volume" :: held 1.189s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:27 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-acd17f48-8c25-462a-a5d6-58d0fa7a705e tempest-GroupSnapshotsTest-1740723573 None] Created reservations ['eb454405-89f9-465c-93bf-cdf13cd0999a'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:27 devstack sudo[84932]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:27 devstack cinder-volume[81938]: WARNING cinder.db.sqlalchemy.api [None req-acd17f48-8c25-462a-a5d6-58d0fa7a705e tempest-GroupSnapshotsTest-1740723573 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1620251213'] Apr 10 10:34:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-fbf741bb-5307-4405-9076-b5f0dbe48075 req-0aeb28a3-84d2-4679-8a1a-8c93e32a57a9 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8920fde9-05b9-496d-bd36-76ff1fe208c8" returned: 0 in 0.584s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:27 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-acd17f48-8c25-462a-a5d6-58d0fa7a705e tempest-GroupSnapshotsTest-1740723573 None] Created reservations ['ebf766e5-9990-499d-841a-17ef1b1ed24d', 'c5d64e45-1a94-47d5-b5c6-618ac3e62c4a', 'acf86851-e1c8-459c-99b5-9e8fda599600', 'c720fbc3-3538-41dc-af97-39320c1f890a'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:27 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-fbf741bb-5307-4405-9076-b5f0dbe48075 req-0aeb28a3-84d2-4679-8a1a-8c93e32a57a9 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Lock "cinder-quobyte-8920fde9-05b9-496d-bd36-76ff1fe208c8" released by "delete_volume" :: held 1.993s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:28 devstack cinder-volume[81938]: DEBUG cinder.quota [req-fbf741bb-5307-4405-9076-b5f0dbe48075 req-0aeb28a3-84d2-4679-8a1a-8c93e32a57a9 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Created reservations ['7365f53a-4b58-4e02-a745-54b7894301c1', 'bde6909a-f48e-4644-ab9e-a7bc29bf2cf1', 'c3496708-4ccf-487f-80a3-affe62cae5b3', 'aea95479-1de5-4277-995f-a9eecc2ecb8e'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-acd17f48-8c25-462a-a5d6-58d0fa7a705e tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-acd17f48-8c25-462a-a5d6-58d0fa7a705e tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:28 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-acd17f48-8c25-462a-a5d6-58d0fa7a705e tempest-GroupSnapshotsTest-1740723573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:28 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-acd17f48-8c25-462a-a5d6-58d0fa7a705e tempest-GroupSnapshotsTest-1740723573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-acd17f48-8c25-462a-a5d6-58d0fa7a705e tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-acd17f48-8c25-462a-a5d6-58d0fa7a705e tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-fbf741bb-5307-4405-9076-b5f0dbe48075 req-0aeb28a3-84d2-4679-8a1a-8c93e32a57a9 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-fbf741bb-5307-4405-9076-b5f0dbe48075 req-0aeb28a3-84d2-4679-8a1a-8c93e32a57a9 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:28 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [req-fbf741bb-5307-4405-9076-b5f0dbe48075 req-0aeb28a3-84d2-4679-8a1a-8c93e32a57a9 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:28 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [req-fbf741bb-5307-4405-9076-b5f0dbe48075 req-0aeb28a3-84d2-4679-8a1a-8c93e32a57a9 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-fbf741bb-5307-4405-9076-b5f0dbe48075 req-0aeb28a3-84d2-4679-8a1a-8c93e32a57a9 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:28 devstack sudo[84936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:34:28 devstack sudo[84936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-fbf741bb-5307-4405-9076-b5f0dbe48075 req-0aeb28a3-84d2-4679-8a1a-8c93e32a57a9 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:28 devstack sudo[84938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:34:28 devstack sudo[84938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f22a4181-8bf9-4278-b5cb-5128d481e3e1 tempest-SnapshotsActionsTest-1794961271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f22a4181-8bf9-4278-b5cb-5128d481e3e1 tempest-SnapshotsActionsTest-1794961271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:28 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-f22a4181-8bf9-4278-b5cb-5128d481e3e1 tempest-SnapshotsActionsTest-1794961271 None] Creating offline snapshot 2474f901-c042-42fd-86e6-8120a607add5 of volume b2412c9d-1e54-4007-8a34-45472c0541f3 {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:34:28 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a191aef-058c-470f-b35c-43e87d57010d]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f22a4181-8bf9-4278-b5cb-5128d481e3e1 tempest-SnapshotsActionsTest-1794961271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:28 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-345aa3a8-87a2-4c30-853a-47a7ae95674e tempest-GroupsTest-1301316427 None] Acquiring lock "cinder-quobyte-875f42c9-f633-4bef-af76-da0738dec648" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:28 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-345aa3a8-87a2-4c30-853a-47a7ae95674e tempest-GroupsTest-1301316427 None] Lock "cinder-quobyte-875f42c9-f633-4bef-af76-da0738dec648" acquired by "delete_volume" :: waited 0.016s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:28 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[9980a917-c964-4828-9d95-430dc0489e21]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:28 devstack sudo[84940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 Apr 10 10:34:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-345aa3a8-87a2-4c30-853a-47a7ae95674e tempest-GroupsTest-1301316427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-875f42c9-f633-4bef-af76-da0738dec648 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:28 devstack sudo[84940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:28 devstack sudo[84942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-875f42c9-f633-4bef-af76-da0738dec648 Apr 10 10:34:28 devstack sudo[84942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:28 devstack sudo[84938]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-fbf741bb-5307-4405-9076-b5f0dbe48075 req-0aeb28a3-84d2-4679-8a1a-8c93e32a57a9 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.527s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:28 devstack cinder-volume[81938]: DEBUG cinder.manager [req-fbf741bb-5307-4405-9076-b5f0dbe48075 req-0aeb28a3-84d2-4679-8a1a-8c93e32a57a9 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:34:28 devstack cinder-volume[81938]: INFO cinder.volume.manager [req-fbf741bb-5307-4405-9076-b5f0dbe48075 req-0aeb28a3-84d2-4679-8a1a-8c93e32a57a9 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Deleted volume successfully. Apr 10 10:34:28 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-fbf741bb-5307-4405-9076-b5f0dbe48075 req-0aeb28a3-84d2-4679-8a1a-8c93e32a57a9 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Lock "cinder-8920fde9-05b9-496d-bd36-76ff1fe208c8-delete_volume" released by "delete_volume" :: held 2.796s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:28 devstack sudo[84936]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-acd17f48-8c25-462a-a5d6-58d0fa7a705e tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.617s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:28 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-acd17f48-8c25-462a-a5d6-58d0fa7a705e tempest-GroupSnapshotsTest-1740723573 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:34:28 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-acd17f48-8c25-462a-a5d6-58d0fa7a705e tempest-GroupSnapshotsTest-1740723573 None] Delete group completed successfully. Apr 10 10:34:29 devstack sudo[84940]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f22a4181-8bf9-4278-b5cb-5128d481e3e1 tempest-SnapshotsActionsTest-1794961271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742" returned: 0 in 0.783s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:29 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-f22a4181-8bf9-4278-b5cb-5128d481e3e1 tempest-SnapshotsActionsTest-1794961271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2412c9d-1e54-4007-8a34-45472c0541f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:34:29 devstack sudo[84942]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f22a4181-8bf9-4278-b5cb-5128d481e3e1 tempest-SnapshotsActionsTest-1794961271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.2474f901-c042-42fd-86e6-8120a607add5 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-345aa3a8-87a2-4c30-853a-47a7ae95674e tempest-GroupsTest-1301316427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-875f42c9-f633-4bef-af76-da0738dec648" returned: 0 in 0.633s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-345aa3a8-87a2-4c30-853a-47a7ae95674e tempest-GroupsTest-1301316427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-875f42c9-f633-4bef-af76-da0738dec648 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:29 devstack sudo[84952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.2474f901-c042-42fd-86e6-8120a607add5 1G Apr 10 10:34:29 devstack sudo[84952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:29 devstack sudo[84953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-875f42c9-f633-4bef-af76-da0738dec648 Apr 10 10:34:29 devstack sudo[84953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:29 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-d83eb956-1e8d-481e-a2a2-93197ff377cb tempest-GroupSnapshotsTest-1740723573 None] Group tempest-GroupSnapshotsTest-Group-1208081264: creating Apr 10 10:34:29 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-d83eb956-1e8d-481e-a2a2-93197ff377cb tempest-GroupSnapshotsTest-1740723573 None] Group tempest-GroupSnapshotsTest-Group-1208081264: created successfully Apr 10 10:34:29 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-d83eb956-1e8d-481e-a2a2-93197ff377cb tempest-GroupSnapshotsTest-1740723573 None] Create group completed successfully. Apr 10 10:34:29 devstack sudo[84953]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-345aa3a8-87a2-4c30-853a-47a7ae95674e tempest-GroupsTest-1301316427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-875f42c9-f633-4bef-af76-da0738dec648" returned: 0 in 0.611s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:29 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-345aa3a8-87a2-4c30-853a-47a7ae95674e tempest-GroupsTest-1301316427 None] Lock "cinder-quobyte-875f42c9-f633-4bef-af76-da0738dec648" released by "delete_volume" :: held 1.271s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:29 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-345aa3a8-87a2-4c30-853a-47a7ae95674e tempest-GroupsTest-1301316427 None] Created reservations ['0c58ae14-4ed1-42e3-8b40-bb081fc90623'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:29 devstack cinder-volume[81938]: WARNING cinder.quota [None req-345aa3a8-87a2-4c30-853a-47a7ae95674e tempest-GroupsTest-1301316427 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1096868390 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1096868390, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:34:29 devstack cinder-volume[81938]: WARNING cinder.quota [None req-345aa3a8-87a2-4c30-853a-47a7ae95674e tempest-GroupsTest-1301316427 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1096868390 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1096868390, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:34:29 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-345aa3a8-87a2-4c30-853a-47a7ae95674e tempest-GroupsTest-1301316427 None] Created reservations ['19749fd5-f7ca-472d-82b7-c2200489bc8a', '17acac00-83a2-4f29-a9d2-118c162fc069', '3758b001-59dd-4d58-860b-8127304d160a', 'b148f0af-c04e-4bc6-a5f3-ca69db5845eb'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:29 devstack sudo[84952]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f22a4181-8bf9-4278-b5cb-5128d481e3e1 tempest-SnapshotsActionsTest-1794961271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.2474f901-c042-42fd-86e6-8120a607add5 1G" returned: 0 in 0.773s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f22a4181-8bf9-4278-b5cb-5128d481e3e1 tempest-SnapshotsActionsTest-1794961271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.2474f901-c042-42fd-86e6-8120a607add5 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:29 devstack sudo[84961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.2474f901-c042-42fd-86e6-8120a607add5 Apr 10 10:34:29 devstack sudo[84961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-345aa3a8-87a2-4c30-853a-47a7ae95674e tempest-GroupsTest-1301316427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-345aa3a8-87a2-4c30-853a-47a7ae95674e tempest-GroupsTest-1301316427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:29 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-345aa3a8-87a2-4c30-853a-47a7ae95674e tempest-GroupsTest-1301316427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:29 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-345aa3a8-87a2-4c30-853a-47a7ae95674e tempest-GroupsTest-1301316427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-345aa3a8-87a2-4c30-853a-47a7ae95674e tempest-GroupsTest-1301316427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-345aa3a8-87a2-4c30-853a-47a7ae95674e tempest-GroupsTest-1301316427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:29 devstack sudo[84963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:34:29 devstack sudo[84963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:30 devstack sudo[84961]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f22a4181-8bf9-4278-b5cb-5128d481e3e1 tempest-SnapshotsActionsTest-1794961271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.2474f901-c042-42fd-86e6-8120a607add5" returned: 0 in 0.500s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:30 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-f22a4181-8bf9-4278-b5cb-5128d481e3e1 tempest-SnapshotsActionsTest-1794961271 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.2474f901-c042-42fd-86e6-8120a607add5 is being set with open permissions: ugo+rw Apr 10 10:34:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f22a4181-8bf9-4278-b5cb-5128d481e3e1 tempest-SnapshotsActionsTest-1794961271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.2474f901-c042-42fd-86e6-8120a607add5 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:30 devstack sudo[84963]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-345aa3a8-87a2-4c30-853a-47a7ae95674e tempest-GroupsTest-1301316427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.470s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:30 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-345aa3a8-87a2-4c30-853a-47a7ae95674e tempest-GroupsTest-1301316427 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:34:30 devstack sudo[84969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.2474f901-c042-42fd-86e6-8120a607add5 Apr 10 10:34:30 devstack sudo[84969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:30 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-345aa3a8-87a2-4c30-853a-47a7ae95674e tempest-GroupsTest-1301316427 None] Delete group completed successfully. Apr 10 10:34:30 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-8954f05b-1b18-40dc-b95f-39e30274072e tempest-GroupsTest-1301316427 None] Created reservations ['74dae7f6-2f93-41ac-97d5-07310de17028'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8954f05b-1b18-40dc-b95f-39e30274072e tempest-GroupsTest-1301316427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8954f05b-1b18-40dc-b95f-39e30274072e tempest-GroupsTest-1301316427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:30 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-8954f05b-1b18-40dc-b95f-39e30274072e tempest-GroupsTest-1301316427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:30 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-8954f05b-1b18-40dc-b95f-39e30274072e tempest-GroupsTest-1301316427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8954f05b-1b18-40dc-b95f-39e30274072e tempest-GroupsTest-1301316427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8954f05b-1b18-40dc-b95f-39e30274072e tempest-GroupsTest-1301316427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:30 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:34:30 devstack sudo[84998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:34:30 devstack sudo[84998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:30 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] Flow 'volume_create_manager' (3cd537bf-2432-4a02-9d7f-0ff685b344fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:30 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1537c15e-8ae7-4d3f-808b-1e5ea11f526f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1537c15e-8ae7-4d3f-808b-1e5ea11f526f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-562717392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c8b19f23-276e-434a-86b6-681e4f3a1457,host='devstack@QuobyteHD#QuobyteHD',id=bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a15dddae0a2549fba50df6f678735c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:31Z,use_quota=True,user_id='bf543574a01342fb8c6fca09afe3370f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(716480eb-969f-4e4d-b599-e24d6ffbf904),volume_type_id=716480eb-969f-4e4d-b599-e24d6ffbf904)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d60897-958d-4c86-902f-f20b11155d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d60897-958d-4c86-902f-f20b11155d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ec5da1-15f2-4551-a950-23c7ae0b3b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ec5da1-15f2-4551-a950-23c7ae0b3b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7', 'volume_name': 'volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d09a5ba1-99ed-4551-8753-3f51f6b34993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d09a5ba1-99ed-4551-8753-3f51f6b34993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e77a78a-3773-47f6-9f03-2f574567132a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:31 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] Volume bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7', 'volume_size': 1} Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:31 devstack sudo[84969]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f22a4181-8bf9-4278-b5cb-5128d481e3e1 tempest-SnapshotsActionsTest-1794961271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.2474f901-c042-42fd-86e6-8120a607add5" returned: 0 in 0.739s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f22a4181-8bf9-4278-b5cb-5128d481e3e1 tempest-SnapshotsActionsTest-1794961271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.892s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.117s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c8b19f23-276e-434a-86b6-681e4f3a1457,created_at=2026-04-10T08:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-562717392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c8b19f23-276e-434a-86b6-681e4f3a1457,host='devstack@QuobyteHD#QuobyteHD',id=bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a15dddae0a2549fba50df6f678735c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:31Z,use_quota=True,user_id='bf543574a01342fb8c6fca09afe3370f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(716480eb-969f-4e4d-b599-e24d6ffbf904),volume_type_id=716480eb-969f-4e4d-b599-e24d6ffbf904)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] Creating volume bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:34:31 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:31 devstack sudo[85002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7 1073741824 Apr 10 10:34:31 devstack sudo[85002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:31 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-f22a4181-8bf9-4278-b5cb-5128d481e3e1 tempest-SnapshotsActionsTest-1794961271 None] Create snapshot completed successfully Apr 10 10:34:31 devstack sudo[84998]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8954f05b-1b18-40dc-b95f-39e30274072e tempest-GroupsTest-1301316427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.570s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-8954f05b-1b18-40dc-b95f-39e30274072e tempest-GroupsTest-1301316427 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b078c867-9809-4ea6-93ba-976770a2d982 tempest-SnapshotsActionsTest-474110311 None] Acquiring lock "cinder-2474f901-c042-42fd-86e6-8120a607add5-delete_snapshot" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:31 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-8954f05b-1b18-40dc-b95f-39e30274072e tempest-GroupsTest-1301316427 None] Delete group completed successfully. Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b078c867-9809-4ea6-93ba-976770a2d982 tempest-SnapshotsActionsTest-474110311 None] Lock "cinder-2474f901-c042-42fd-86e6-8120a607add5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b078c867-9809-4ea6-93ba-976770a2d982 tempest-SnapshotsActionsTest-474110311 None] Acquiring lock "cinder-quobyte-b2412c9d-1e54-4007-8a34-45472c0541f3" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b078c867-9809-4ea6-93ba-976770a2d982 tempest-SnapshotsActionsTest-474110311 None] Lock "cinder-quobyte-b2412c9d-1e54-4007-8a34-45472c0541f3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b078c867-9809-4ea6-93ba-976770a2d982 tempest-SnapshotsActionsTest-474110311 None] Acquiring lock "cinder-quobyte-2474f901-c042-42fd-86e6-8120a607add5" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b078c867-9809-4ea6-93ba-976770a2d982 tempest-SnapshotsActionsTest-474110311 None] Lock "cinder-quobyte-2474f901-c042-42fd-86e6-8120a607add5" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-b078c867-9809-4ea6-93ba-976770a2d982 tempest-SnapshotsActionsTest-474110311 None] Deleting offline snapshot 2474f901-c042-42fd-86e6-8120a607add5 of volume b2412c9d-1e54-4007-8a34-45472c0541f3 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-b078c867-9809-4ea6-93ba-976770a2d982 tempest-SnapshotsActionsTest-474110311 None] snapshot_file for this snap is: volume-b2412c9d-1e54-4007-8a34-45472c0541f3.2474f901-c042-42fd-86e6-8120a607add5 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3cbc4f-7fe2-430c-92ac-dd0ddf46b4bf]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b078c867-9809-4ea6-93ba-976770a2d982 tempest-SnapshotsActionsTest-474110311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.2474f901-c042-42fd-86e6-8120a607add5 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:31 devstack sudo[85008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.2474f901-c042-42fd-86e6-8120a607add5 Apr 10 10:34:31 devstack sudo[85008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:31 devstack sudo[85002]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7 1073741824" returned: 0 in 0.619s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:31 devstack sudo[85010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7 Apr 10 10:34:31 devstack sudo[85010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:32 devstack sudo[85008]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b078c867-9809-4ea6-93ba-976770a2d982 tempest-SnapshotsActionsTest-474110311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.2474f901-c042-42fd-86e6-8120a607add5" returned: 0 in 0.698s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:32 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-b078c867-9809-4ea6-93ba-976770a2d982 tempest-SnapshotsActionsTest-474110311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2412c9d-1e54-4007-8a34-45472c0541f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:34:32 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a9e8a1-199f-41d7-8ee1-c5d817a6ddf7]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b078c867-9809-4ea6-93ba-976770a2d982 tempest-SnapshotsActionsTest-474110311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:32 devstack sudo[85015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 Apr 10 10:34:32 devstack sudo[85015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:32 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-bf3c5e09-9cbd-4fd8-b081-29762ef2da4a tempest-GroupsTest-1301316427 None] Group tempest-GroupsTest-Group-695425333: creating Apr 10 10:34:32 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-bf3c5e09-9cbd-4fd8-b081-29762ef2da4a tempest-GroupsTest-1301316427 None] Group tempest-GroupsTest-Group-695425333: created successfully Apr 10 10:34:32 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-bf3c5e09-9cbd-4fd8-b081-29762ef2da4a tempest-GroupsTest-1301316427 None] Create group completed successfully. Apr 10 10:34:32 devstack sudo[85010]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7" returned: 0 in 0.806s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:32 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:34:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:32 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e77a78a-3773-47f6-9f03-2f574567132a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:32 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a105912-ec18-4861-8df1-4a3f749b6073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:32 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] Volume volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7 (bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7): created successfully Apr 10 10:34:32 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a105912-ec18-4861-8df1-4a3f749b6073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:32 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] Flow 'volume_create_manager' (3cd537bf-2432-4a02-9d7f-0ff685b344fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:32 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-7fb0758a-01c5-4979-8847-fe16046f7441 tempest-GroupSnapshotsTest-1740723573 None] Created volume successfully. Apr 10 10:34:33 devstack sudo[85015]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b078c867-9809-4ea6-93ba-976770a2d982 tempest-SnapshotsActionsTest-474110311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742" returned: 0 in 0.665s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:33 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-b078c867-9809-4ea6-93ba-976770a2d982 tempest-SnapshotsActionsTest-474110311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2412c9d-1e54-4007-8a34-45472c0541f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:34:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b078c867-9809-4ea6-93ba-976770a2d982 tempest-SnapshotsActionsTest-474110311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.2474f901-c042-42fd-86e6-8120a607add5 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:33 devstack sudo[85022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.2474f901-c042-42fd-86e6-8120a607add5 Apr 10 10:34:33 devstack sudo[85022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:33 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:34:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] Flow 'volume_create_manager' (d2f6f999-5326-497c-8ae0-ea537fef8ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c4555b-56bd-4cb4-b094-7ab4fe9ce757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c4555b-56bd-4cb4-b094-7ab4fe9ce757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1781259183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c8b19f23-276e-434a-86b6-681e4f3a1457,host='devstack@QuobyteHD#QuobyteHD',id=2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a15dddae0a2549fba50df6f678735c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:33Z,use_quota=True,user_id='bf543574a01342fb8c6fca09afe3370f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(716480eb-969f-4e4d-b599-e24d6ffbf904),volume_type_id=716480eb-969f-4e4d-b599-e24d6ffbf904)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a164bae-8e15-4592-b5a1-b125e4a01b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a164bae-8e15-4592-b5a1-b125e4a01b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6207c37-2586-4a1c-b719-e056c443585f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6207c37-2586-4a1c-b719-e056c443585f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0', 'volume_name': 'volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618f4a19-bd1f-46d4-9930-009a81809a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618f4a19-bd1f-46d4-9930-009a81809a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9621b825-2c4d-45d6-8206-de237abfbc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:33 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] Volume 2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0', 'volume_size': 1} Apr 10 10:34:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:33 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c8b19f23-276e-434a-86b6-681e4f3a1457,created_at=2026-04-10T08:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1781259183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c8b19f23-276e-434a-86b6-681e4f3a1457,host='devstack@QuobyteHD#QuobyteHD',id=2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a15dddae0a2549fba50df6f678735c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:33Z,use_quota=True,user_id='bf543574a01342fb8c6fca09afe3370f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(716480eb-969f-4e4d-b599-e24d6ffbf904),volume_type_id=716480eb-969f-4e4d-b599-e24d6ffbf904)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:34:33 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] Creating volume 2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:34:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:33 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:33 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:33 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:34:33 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:34:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:33 devstack sudo[85027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0 1073741824 Apr 10 10:34:33 devstack sudo[85027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:33 devstack sudo[85022]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b078c867-9809-4ea6-93ba-976770a2d982 tempest-SnapshotsActionsTest-474110311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.2474f901-c042-42fd-86e6-8120a607add5" returned: 0 in 0.703s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b078c867-9809-4ea6-93ba-976770a2d982 tempest-SnapshotsActionsTest-474110311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.2474f901-c042-42fd-86e6-8120a607add5 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:33 devstack sudo[85029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.2474f901-c042-42fd-86e6-8120a607add5 Apr 10 10:34:33 devstack sudo[85029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] Flow 'volume_create_manager' (f035e385-27c4-49aa-8b4f-1dd64f356c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b31aabd-7c6b-44e4-ba49-35625aae1590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b31aabd-7c6b-44e4-ba49-35625aae1590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-302238343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8961203a-3033-4d1f-b4f7-9cba23727315,host='devstack@QuobyteHD#QuobyteHD',id=c862fe2c-1ae7-4c5d-80be-fad6f271497c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='274e3a06d911446486afc4c741461782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:34Z,use_quota=True,user_id='6a67f4234bcc4b0c9cd0d7412ec6f47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(304b69af-dd9d-42c9-aaea-c5f6b30f4fda),volume_type_id=304b69af-dd9d-42c9-aaea-c5f6b30f4fda)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (711e79e6-9f0e-4758-8588-600ca7386e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (711e79e6-9f0e-4758-8588-600ca7386e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4aa3a69-fe04-4eb6-91d0-b3874ed8607b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4aa3a69-fe04-4eb6-91d0-b3874ed8607b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c862fe2c-1ae7-4c5d-80be-fad6f271497c', 'volume_name': 'volume-c862fe2c-1ae7-4c5d-80be-fad6f271497c', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49753628-b935-4ed6-952b-46fa07e958ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49753628-b935-4ed6-952b-46fa07e958ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5feedcd5-1086-465b-8feb-54570bd8d0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:34 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] Volume c862fe2c-1ae7-4c5d-80be-fad6f271497c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c862fe2c-1ae7-4c5d-80be-fad6f271497c', 'volume_size': 1} Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:34 devstack sudo[85029]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b078c867-9809-4ea6-93ba-976770a2d982 tempest-SnapshotsActionsTest-474110311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.2474f901-c042-42fd-86e6-8120a607add5" returned: 0 in 0.628s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:34 devstack sudo[85027]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b078c867-9809-4ea6-93ba-976770a2d982 tempest-SnapshotsActionsTest-474110311 None] Lock "cinder-quobyte-2474f901-c042-42fd-86e6-8120a607add5" released by "_delete_snapshot" :: held 2.774s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0 1073741824" returned: 0 in 0.850s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b078c867-9809-4ea6-93ba-976770a2d982 tempest-SnapshotsActionsTest-474110311 None] Lock "cinder-quobyte-b2412c9d-1e54-4007-8a34-45472c0541f3" released by "delete_snapshot" :: held 2.802s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:34 devstack sudo[85035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0 Apr 10 10:34:34 devstack sudo[85035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-b078c867-9809-4ea6-93ba-976770a2d982 tempest-SnapshotsActionsTest-474110311 None] Created reservations ['f0f9c117-26c5-45a9-b9f5-c90249c32ec1', '9f9e6bff-88cb-46b1-a0ec-a87baeedfcae', 'f9947bbe-7a3d-4530-a3a0-b7f12b64b859', '0aaffccd-1c71-4474-ae52-127ae9ad9029'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:34 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-b078c867-9809-4ea6-93ba-976770a2d982 tempest-SnapshotsActionsTest-474110311 None] Delete snapshot completed successfully. Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b078c867-9809-4ea6-93ba-976770a2d982 tempest-SnapshotsActionsTest-474110311 None] Lock "cinder-2474f901-c042-42fd-86e6-8120a607add5-delete_snapshot" released by "delete_snapshot" :: held 2.937s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:34 devstack sudo[85035]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0" returned: 0 in 0.548s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.848s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8961203a-3033-4d1f-b4f7-9cba23727315,created_at=2026-04-10T08:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-302238343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8961203a-3033-4d1f-b4f7-9cba23727315,host='devstack@QuobyteHD#QuobyteHD',id=c862fe2c-1ae7-4c5d-80be-fad6f271497c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='274e3a06d911446486afc4c741461782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:34Z,use_quota=True,user_id='6a67f4234bcc4b0c9cd0d7412ec6f47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(304b69af-dd9d-42c9-aaea-c5f6b30f4fda),volume_type_id=304b69af-dd9d-42c9-aaea-c5f6b30f4fda)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] Creating volume c862fe2c-1ae7-4c5d-80be-fad6f271497c {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:34:34 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c862fe2c-1ae7-4c5d-80be-fad6f271497c 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:34 devstack sudo[85038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c862fe2c-1ae7-4c5d-80be-fad6f271497c 1073741824 Apr 10 10:34:34 devstack sudo[85038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9621b825-2c4d-45d6-8206-de237abfbc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:34 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca7d881-742e-4726-80b6-d7cdc36ea1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:35 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] Volume volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0 (2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0): created successfully Apr 10 10:34:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca7d881-742e-4726-80b6-d7cdc36ea1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] Flow 'volume_create_manager' (d2f6f999-5326-497c-8ae0-ea537fef8ce1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:35 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-7408e407-4fdd-42b3-b46d-5c59ac5941e9 tempest-GroupSnapshotsTest-1740723573 None] Created volume successfully. Apr 10 10:34:35 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-9d5e694c-bc2f-4e3c-a833-7dbc71588fb6 tempest-SnapshotsActionsTest-1794961271 None] Acquiring lock "cinder-da305a51-b55b-446f-8967-a30332b12742-delete_snapshot" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:35 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-9d5e694c-bc2f-4e3c-a833-7dbc71588fb6 tempest-SnapshotsActionsTest-1794961271 None] Lock "cinder-da305a51-b55b-446f-8967-a30332b12742-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:35 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-9d5e694c-bc2f-4e3c-a833-7dbc71588fb6 tempest-SnapshotsActionsTest-1794961271 None] Acquiring lock "cinder-quobyte-b2412c9d-1e54-4007-8a34-45472c0541f3" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:35 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-9d5e694c-bc2f-4e3c-a833-7dbc71588fb6 tempest-SnapshotsActionsTest-1794961271 None] Lock "cinder-quobyte-b2412c9d-1e54-4007-8a34-45472c0541f3" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:35 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-9d5e694c-bc2f-4e3c-a833-7dbc71588fb6 tempest-SnapshotsActionsTest-1794961271 None] Acquiring lock "cinder-quobyte-da305a51-b55b-446f-8967-a30332b12742" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:35 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-9d5e694c-bc2f-4e3c-a833-7dbc71588fb6 tempest-SnapshotsActionsTest-1794961271 None] Lock "cinder-quobyte-da305a51-b55b-446f-8967-a30332b12742" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:35 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-9d5e694c-bc2f-4e3c-a833-7dbc71588fb6 tempest-SnapshotsActionsTest-1794961271 None] Deleting offline snapshot da305a51-b55b-446f-8967-a30332b12742 of volume b2412c9d-1e54-4007-8a34-45472c0541f3 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:34:35 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-9d5e694c-bc2f-4e3c-a833-7dbc71588fb6 tempest-SnapshotsActionsTest-1794961271 None] snapshot_file for this snap is: volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:34:35 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a150f1-66e1-430f-9b4f-8bcf158d5086]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9d5e694c-bc2f-4e3c-a833-7dbc71588fb6 tempest-SnapshotsActionsTest-1794961271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:35 devstack sudo[85040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 Apr 10 10:34:35 devstack sudo[85040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:35 devstack sudo[85038]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c862fe2c-1ae7-4c5d-80be-fad6f271497c 1073741824" returned: 0 in 0.560s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c862fe2c-1ae7-4c5d-80be-fad6f271497c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:35 devstack sudo[85045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c862fe2c-1ae7-4c5d-80be-fad6f271497c Apr 10 10:34:35 devstack sudo[85045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:35 devstack sudo[85040]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9d5e694c-bc2f-4e3c-a833-7dbc71588fb6 tempest-SnapshotsActionsTest-1794961271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742" returned: 0 in 0.619s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:35 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-9d5e694c-bc2f-4e3c-a833-7dbc71588fb6 tempest-SnapshotsActionsTest-1794961271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2412c9d-1e54-4007-8a34-45472c0541f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:34:35 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cb9be8-04cd-4bc0-8df4-d175c64f0814]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9d5e694c-bc2f-4e3c-a833-7dbc71588fb6 tempest-SnapshotsActionsTest-1794961271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:35 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-66857e9c-16f0-40d0-8094-a35349aa7578 tempest-GroupSnapshotsTest-1740723573 None] Update group completed successfully. Apr 10 10:34:35 devstack sudo[85050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3 Apr 10 10:34:35 devstack sudo[85050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:36 devstack sudo[85045]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c862fe2c-1ae7-4c5d-80be-fad6f271497c" returned: 0 in 0.502s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5feedcd5-1086-465b-8feb-54570bd8d0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c862fe2c-1ae7-4c5d-80be-fad6f271497c', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3826374f-eba3-406d-9fe9-cf896de7688c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:36 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] Volume volume-c862fe2c-1ae7-4c5d-80be-fad6f271497c (c862fe2c-1ae7-4c5d-80be-fad6f271497c): created successfully Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3826374f-eba3-406d-9fe9-cf896de7688c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] Flow 'volume_create_manager' (f035e385-27c4-49aa-8b4f-1dd64f356c8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:36 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-3d376780-1bb7-480b-a6c0-88149e270d89 tempest-GroupsTest-1301316427 None] Created volume successfully. Apr 10 10:34:36 devstack sudo[85050]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9d5e694c-bc2f-4e3c-a833-7dbc71588fb6 tempest-SnapshotsActionsTest-1794961271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3" returned: 0 in 0.535s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9d5e694c-bc2f-4e3c-a833-7dbc71588fb6 tempest-SnapshotsActionsTest-1794961271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:36 devstack sudo[85056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 Apr 10 10:34:36 devstack sudo[85056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] Flow 'volume_create_manager' (c4c3a7df-e526-4945-9ab3-436b04119500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (407e1886-56f0-4f59-b3b6-f14c6f666d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (407e1886-56f0-4f59-b3b6-f14c6f666d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2046981352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8961203a-3033-4d1f-b4f7-9cba23727315,host='devstack@QuobyteHD#QuobyteHD',id=592f7692-70e6-4731-ae22-63537a2ae79e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='274e3a06d911446486afc4c741461782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:37Z,use_quota=True,user_id='6a67f4234bcc4b0c9cd0d7412ec6f47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(304b69af-dd9d-42c9-aaea-c5f6b30f4fda),volume_type_id=304b69af-dd9d-42c9-aaea-c5f6b30f4fda)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c647d005-2dcf-4cfe-9447-5c87318813fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c647d005-2dcf-4cfe-9447-5c87318813fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c5a314-6173-4f86-b882-1d1ede2721a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c5a314-6173-4f86-b882-1d1ede2721a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '592f7692-70e6-4731-ae22-63537a2ae79e', 'volume_name': 'volume-592f7692-70e6-4731-ae22-63537a2ae79e', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5adb9255-0dd1-46bc-9b50-e82e6516ebc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5adb9255-0dd1-46bc-9b50-e82e6516ebc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aa54fc6-73a6-4d18-a8d6-9ab08f644d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:36 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] Volume 592f7692-70e6-4731-ae22-63537a2ae79e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-592f7692-70e6-4731-ae22-63537a2ae79e', 'volume_size': 1} Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8961203a-3033-4d1f-b4f7-9cba23727315,created_at=2026-04-10T08:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2046981352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8961203a-3033-4d1f-b4f7-9cba23727315,host='devstack@QuobyteHD#QuobyteHD',id=592f7692-70e6-4731-ae22-63537a2ae79e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='274e3a06d911446486afc4c741461782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:37Z,use_quota=True,user_id='6a67f4234bcc4b0c9cd0d7412ec6f47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(304b69af-dd9d-42c9-aaea-c5f6b30f4fda),volume_type_id=304b69af-dd9d-42c9-aaea-c5f6b30f4fda)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] Creating volume 592f7692-70e6-4731-ae22-63537a2ae79e {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:34:36 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-592f7692-70e6-4731-ae22-63537a2ae79e 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:36 devstack sudo[85058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-592f7692-70e6-4731-ae22-63537a2ae79e 1073741824 Apr 10 10:34:36 devstack sudo[85058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:36 devstack sudo[85056]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9d5e694c-bc2f-4e3c-a833-7dbc71588fb6 tempest-SnapshotsActionsTest-1794961271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742" returned: 0 in 0.617s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9d5e694c-bc2f-4e3c-a833-7dbc71588fb6 tempest-SnapshotsActionsTest-1794961271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:37 devstack sudo[85063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742 Apr 10 10:34:37 devstack sudo[85063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:37 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-c76a7a8d-7c6d-4e00-8c38-2cc9b479d3ea tempest-GroupSnapshotsTest-1740723573 None] Update group completed successfully. Apr 10 10:34:37 devstack sudo[85058]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-592f7692-70e6-4731-ae22-63537a2ae79e 1073741824" returned: 0 in 0.678s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-592f7692-70e6-4731-ae22-63537a2ae79e {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:37 devstack sudo[85068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-592f7692-70e6-4731-ae22-63537a2ae79e Apr 10 10:34:37 devstack sudo[85068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:37 devstack sudo[85063]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9d5e694c-bc2f-4e3c-a833-7dbc71588fb6 tempest-SnapshotsActionsTest-1794961271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3.da305a51-b55b-446f-8967-a30332b12742" returned: 0 in 0.586s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:37 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-9d5e694c-bc2f-4e3c-a833-7dbc71588fb6 tempest-SnapshotsActionsTest-1794961271 None] Lock "cinder-quobyte-da305a51-b55b-446f-8967-a30332b12742" released by "_delete_snapshot" :: held 2.505s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:37 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-9d5e694c-bc2f-4e3c-a833-7dbc71588fb6 tempest-SnapshotsActionsTest-1794961271 None] Lock "cinder-quobyte-b2412c9d-1e54-4007-8a34-45472c0541f3" released by "delete_snapshot" :: held 2.520s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:37 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-9d5e694c-bc2f-4e3c-a833-7dbc71588fb6 tempest-SnapshotsActionsTest-1794961271 None] Created reservations ['a3d7b80c-5793-4f29-bd61-d0813305cb4b', '671db399-6cfa-4ca4-bbc6-e3f03ceb96d3', 'cf74ad0c-4750-4210-99a9-e2294bf2cf5e', 'e2c6368c-3c9d-4200-b05f-4db3f0415c33'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:37 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-9d5e694c-bc2f-4e3c-a833-7dbc71588fb6 tempest-SnapshotsActionsTest-1794961271 None] Delete snapshot completed successfully. Apr 10 10:34:37 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-9d5e694c-bc2f-4e3c-a833-7dbc71588fb6 tempest-SnapshotsActionsTest-1794961271 None] Lock "cinder-da305a51-b55b-446f-8967-a30332b12742-delete_snapshot" released by "delete_snapshot" :: held 2.639s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:37 devstack sudo[85068]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-592f7692-70e6-4731-ae22-63537a2ae79e" returned: 0 in 0.508s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:37 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:34:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:37 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aa54fc6-73a6-4d18-a8d6-9ab08f644d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-592f7692-70e6-4731-ae22-63537a2ae79e', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:37 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (341e31f1-0c16-4ec2-b965-26f0e40e999d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:37 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] Volume volume-592f7692-70e6-4731-ae22-63537a2ae79e (592f7692-70e6-4731-ae22-63537a2ae79e): created successfully Apr 10 10:34:37 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (341e31f1-0c16-4ec2-b965-26f0e40e999d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:37 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] Flow 'volume_create_manager' (c4c3a7df-e526-4945-9ab3-436b04119500) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:37 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-8b63d1c6-b350-4ebd-993a-cd6ce402cb37 tempest-GroupsTest-1301316427 None] Created volume successfully. Apr 10 10:34:38 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-a7986a23-66b4-4548-b786-e1d940c1ace1 tempest-GroupSnapshotsTest-1740723573 None] Update group completed successfully. Apr 10 10:34:38 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b22f42d0-09c7-43ef-b010-66355156b59f tempest-SnapshotsActionsTest-1794961271 None] Acquiring lock "cinder-b2412c9d-1e54-4007-8a34-45472c0541f3-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:38 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b22f42d0-09c7-43ef-b010-66355156b59f tempest-SnapshotsActionsTest-1794961271 None] Lock "cinder-b2412c9d-1e54-4007-8a34-45472c0541f3-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:38 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b22f42d0-09c7-43ef-b010-66355156b59f tempest-SnapshotsActionsTest-1794961271 None] Acquiring lock "cinder-quobyte-b2412c9d-1e54-4007-8a34-45472c0541f3" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:38 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b22f42d0-09c7-43ef-b010-66355156b59f tempest-SnapshotsActionsTest-1794961271 None] Lock "cinder-quobyte-b2412c9d-1e54-4007-8a34-45472c0541f3" acquired by "delete_volume" :: waited 0.012s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:38 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[09980f83-57f6-48d3-a98a-64aa1b505e5e]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b22f42d0-09c7-43ef-b010-66355156b59f tempest-SnapshotsActionsTest-1794961271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:38 devstack sudo[85093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3 Apr 10 10:34:38 devstack sudo[85093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:38 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-8cf4c204-9738-4d99-93f3-7085ff6f527b tempest-GroupsTest-1301316427 None] Update group completed successfully. Apr 10 10:34:39 devstack sudo[85093]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b22f42d0-09c7-43ef-b010-66355156b59f tempest-SnapshotsActionsTest-1794961271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3" returned: 0 in 0.658s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b22f42d0-09c7-43ef-b010-66355156b59f tempest-SnapshotsActionsTest-1794961271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:39 devstack sudo[85100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3 Apr 10 10:34:39 devstack sudo[85100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:39 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-b97bc71f-0810-47b2-9a48-af825a186adb tempest-GroupSnapshotsTest-1740723573 None] Update group completed successfully. Apr 10 10:34:39 devstack sudo[85100]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b22f42d0-09c7-43ef-b010-66355156b59f tempest-SnapshotsActionsTest-1794961271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b2412c9d-1e54-4007-8a34-45472c0541f3" returned: 0 in 0.607s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:39 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b22f42d0-09c7-43ef-b010-66355156b59f tempest-SnapshotsActionsTest-1794961271 None] Lock "cinder-quobyte-b2412c9d-1e54-4007-8a34-45472c0541f3" released by "delete_volume" :: held 1.306s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:39 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-b22f42d0-09c7-43ef-b010-66355156b59f tempest-SnapshotsActionsTest-1794961271 None] Created reservations ['41847f4d-8679-44d6-8872-d843e64eaff8', '0fd65cda-d3ea-404f-a3a7-333f0c7fcda7', '97ca8be4-b52b-43df-9294-df85fa5fb28b', '36bd6f5e-25e2-46dd-b133-1bb1f10ced36'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b22f42d0-09c7-43ef-b010-66355156b59f tempest-SnapshotsActionsTest-1794961271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b22f42d0-09c7-43ef-b010-66355156b59f tempest-SnapshotsActionsTest-1794961271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:39 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b22f42d0-09c7-43ef-b010-66355156b59f tempest-SnapshotsActionsTest-1794961271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:39 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b22f42d0-09c7-43ef-b010-66355156b59f tempest-SnapshotsActionsTest-1794961271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b22f42d0-09c7-43ef-b010-66355156b59f tempest-SnapshotsActionsTest-1794961271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b22f42d0-09c7-43ef-b010-66355156b59f tempest-SnapshotsActionsTest-1794961271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:39 devstack sudo[85104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:34:39 devstack sudo[85104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:40 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-c04a921d-fc62-430c-91dc-c106626cd0bb tempest-GroupsTest-1301316427 None] Update group completed successfully. Apr 10 10:34:40 devstack sudo[85104]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b22f42d0-09c7-43ef-b010-66355156b59f tempest-SnapshotsActionsTest-1794961271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.607s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:40 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-b22f42d0-09c7-43ef-b010-66355156b59f tempest-SnapshotsActionsTest-1794961271 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:34:40 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-b22f42d0-09c7-43ef-b010-66355156b59f tempest-SnapshotsActionsTest-1794961271 None] Deleted volume successfully. Apr 10 10:34:40 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b22f42d0-09c7-43ef-b010-66355156b59f tempest-SnapshotsActionsTest-1794961271 None] Lock "cinder-b2412c9d-1e54-4007-8a34-45472c0541f3-delete_volume" released by "delete_volume" :: held 2.098s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:40 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] GroupSnapshot 3b6d7d2f-3e1d-4dd7-8233-a3f4a9d3c692: creating. Apr 10 10:34:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] Group snapshot 3b6d7d2f-3e1d-4dd7-8233-a3f4a9d3c692: creating. {{(pid=81938) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 10 10:34:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:40 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] Creating offline snapshot 9df28c66-6ae7-4894-835d-57a34f1ffb7d of volume 2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0 {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:34:40 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db53f96-08fb-4c04-b21e-832b5006cd4d]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:40 devstack sudo[85108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0 Apr 10 10:34:40 devstack sudo[85108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:41 devstack cinder-volume[81938]: INFO cinder.volume.manager [req-34c9399b-f809-4856-92e7-ebc2043ad403 req-7782f5a2-898e-4036-86c3-106f51ad255c tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Terminate volume connection completed successfully. Apr 10 10:34:41 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-34c9399b-f809-4856-92e7-ebc2043ad403 req-7782f5a2-898e-4036-86c3-106f51ad255c tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Deleting attachment 2bb2fd2a-3cf4-4803-a7e1-d2a2ab9edb08. {{(pid=81938) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 10 10:34:41 devstack sudo[85108]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0" returned: 0 in 0.672s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0.9df28c66-6ae7-4894-835d-57a34f1ffb7d 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:41 devstack sudo[85113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0.9df28c66-6ae7-4894-835d-57a34f1ffb7d 1G Apr 10 10:34:41 devstack sudo[85113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:41 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-2cae15b3-2f16-4747-92ad-2227afb52ff1 tempest-GroupsTest-1301316427 None] Acquiring lock "cinder-quobyte-592f7692-70e6-4731-ae22-63537a2ae79e" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:41 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-2cae15b3-2f16-4747-92ad-2227afb52ff1 tempest-GroupsTest-1301316427 None] Lock "cinder-quobyte-592f7692-70e6-4731-ae22-63537a2ae79e" acquired by "delete_volume" :: waited 0.023s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:41 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4d8e80-5b6a-4cd8-8102-8206af19b227]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2cae15b3-2f16-4747-92ad-2227afb52ff1 tempest-GroupsTest-1301316427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-592f7692-70e6-4731-ae22-63537a2ae79e {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:41 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-34c9399b-f809-4856-92e7-ebc2043ad403 req-a8bed2b1-50fe-4e23-88ad-d9ee9c703504 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Acquiring lock "cinder-21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:41 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-34c9399b-f809-4856-92e7-ebc2043ad403 req-a8bed2b1-50fe-4e23-88ad-d9ee9c703504 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Lock "cinder-21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:41 devstack sudo[85115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-592f7692-70e6-4731-ae22-63537a2ae79e Apr 10 10:34:41 devstack sudo[85115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:41 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-34c9399b-f809-4856-92e7-ebc2043ad403 req-a8bed2b1-50fe-4e23-88ad-d9ee9c703504 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Acquiring lock "cinder-quobyte-21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:41 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-34c9399b-f809-4856-92e7-ebc2043ad403 req-a8bed2b1-50fe-4e23-88ad-d9ee9c703504 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Lock "cinder-quobyte-21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5" acquired by "delete_volume" :: waited 0.024s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:41 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b9d86d-16d2-4a42-ad29-911e9530bde2]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-34c9399b-f809-4856-92e7-ebc2043ad403 req-a8bed2b1-50fe-4e23-88ad-d9ee9c703504 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:41 devstack sudo[85117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5 Apr 10 10:34:41 devstack sudo[85117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:42 devstack sudo[85113]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0.9df28c66-6ae7-4894-835d-57a34f1ffb7d 1G" returned: 0 in 0.803s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0.9df28c66-6ae7-4894-835d-57a34f1ffb7d {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:42 devstack sudo[85122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0.9df28c66-6ae7-4894-835d-57a34f1ffb7d Apr 10 10:34:42 devstack sudo[85122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:42 devstack sudo[85115]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2cae15b3-2f16-4747-92ad-2227afb52ff1 tempest-GroupsTest-1301316427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-592f7692-70e6-4731-ae22-63537a2ae79e" returned: 0 in 0.824s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2cae15b3-2f16-4747-92ad-2227afb52ff1 tempest-GroupsTest-1301316427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-592f7692-70e6-4731-ae22-63537a2ae79e {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:42 devstack sudo[85127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-592f7692-70e6-4731-ae22-63537a2ae79e Apr 10 10:34:42 devstack sudo[85127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:42 devstack sudo[85117]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-34c9399b-f809-4856-92e7-ebc2043ad403 req-a8bed2b1-50fe-4e23-88ad-d9ee9c703504 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5" returned: 0 in 0.974s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-34c9399b-f809-4856-92e7-ebc2043ad403 req-a8bed2b1-50fe-4e23-88ad-d9ee9c703504 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:42 devstack sudo[85135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5 Apr 10 10:34:42 devstack sudo[85135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:42 devstack sudo[85122]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0.9df28c66-6ae7-4894-835d-57a34f1ffb7d" returned: 0 in 0.654s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:42 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0.9df28c66-6ae7-4894-835d-57a34f1ffb7d is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:34:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0.9df28c66-6ae7-4894-835d-57a34f1ffb7d {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:42 devstack sudo[85137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0.9df28c66-6ae7-4894-835d-57a34f1ffb7d Apr 10 10:34:42 devstack sudo[85137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:43 devstack sudo[85127]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2cae15b3-2f16-4747-92ad-2227afb52ff1 tempest-GroupsTest-1301316427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-592f7692-70e6-4731-ae22-63537a2ae79e" returned: 0 in 0.747s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:43 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-2cae15b3-2f16-4747-92ad-2227afb52ff1 tempest-GroupsTest-1301316427 None] Lock "cinder-quobyte-592f7692-70e6-4731-ae22-63537a2ae79e" released by "delete_volume" :: held 1.606s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:43 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-2cae15b3-2f16-4747-92ad-2227afb52ff1 tempest-GroupsTest-1301316427 None] Acquiring lock "cinder-quobyte-c862fe2c-1ae7-4c5d-80be-fad6f271497c" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:43 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-2cae15b3-2f16-4747-92ad-2227afb52ff1 tempest-GroupsTest-1301316427 None] Lock "cinder-quobyte-c862fe2c-1ae7-4c5d-80be-fad6f271497c" acquired by "delete_volume" :: waited 0.015s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:43 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b672f08-1f39-4167-a9ff-3673ce63c6b9]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2cae15b3-2f16-4747-92ad-2227afb52ff1 tempest-GroupsTest-1301316427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c862fe2c-1ae7-4c5d-80be-fad6f271497c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:43 devstack sudo[85140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c862fe2c-1ae7-4c5d-80be-fad6f271497c Apr 10 10:34:43 devstack sudo[85140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:43 devstack sudo[85135]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-34c9399b-f809-4856-92e7-ebc2043ad403 req-a8bed2b1-50fe-4e23-88ad-d9ee9c703504 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5" returned: 0 in 0.728s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:43 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-34c9399b-f809-4856-92e7-ebc2043ad403 req-a8bed2b1-50fe-4e23-88ad-d9ee9c703504 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Lock "cinder-quobyte-21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5" released by "delete_volume" :: held 1.742s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:43 devstack cinder-volume[81938]: DEBUG cinder.quota [req-34c9399b-f809-4856-92e7-ebc2043ad403 req-a8bed2b1-50fe-4e23-88ad-d9ee9c703504 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Created reservations ['b4bceeb8-4a6a-46e3-8ea6-894c067d57db', 'f6cf285f-5e4d-4a0b-96ab-599b996d2588', '5c2e7527-4389-48ac-8861-bfc0aa2e285e', '286cc262-804b-4b54-b74e-0bb9c77c68d5'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-34c9399b-f809-4856-92e7-ebc2043ad403 req-a8bed2b1-50fe-4e23-88ad-d9ee9c703504 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-34c9399b-f809-4856-92e7-ebc2043ad403 req-a8bed2b1-50fe-4e23-88ad-d9ee9c703504 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:43 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [req-34c9399b-f809-4856-92e7-ebc2043ad403 req-a8bed2b1-50fe-4e23-88ad-d9ee9c703504 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:43 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [req-34c9399b-f809-4856-92e7-ebc2043ad403 req-a8bed2b1-50fe-4e23-88ad-d9ee9c703504 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-34c9399b-f809-4856-92e7-ebc2043ad403 req-a8bed2b1-50fe-4e23-88ad-d9ee9c703504 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-34c9399b-f809-4856-92e7-ebc2043ad403 req-a8bed2b1-50fe-4e23-88ad-d9ee9c703504 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:43 devstack sudo[85144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:34:43 devstack sudo[85144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:43 devstack sudo[85137]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0.9df28c66-6ae7-4894-835d-57a34f1ffb7d" returned: 0 in 0.872s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:43 devstack sudo[85146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0.info Apr 10 10:34:43 devstack sudo[85146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:44 devstack sudo[85140]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2cae15b3-2f16-4747-92ad-2227afb52ff1 tempest-GroupsTest-1301316427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c862fe2c-1ae7-4c5d-80be-fad6f271497c" returned: 0 in 0.824s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2cae15b3-2f16-4747-92ad-2227afb52ff1 tempest-GroupsTest-1301316427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c862fe2c-1ae7-4c5d-80be-fad6f271497c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:44 devstack sudo[85151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c862fe2c-1ae7-4c5d-80be-fad6f271497c Apr 10 10:34:44 devstack sudo[85151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:44 devstack sudo[85144]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-34c9399b-f809-4856-92e7-ebc2043ad403 req-a8bed2b1-50fe-4e23-88ad-d9ee9c703504 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.709s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:44 devstack cinder-volume[81938]: DEBUG cinder.manager [req-34c9399b-f809-4856-92e7-ebc2043ad403 req-a8bed2b1-50fe-4e23-88ad-d9ee9c703504 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:34:44 devstack cinder-volume[81938]: INFO cinder.volume.manager [req-34c9399b-f809-4856-92e7-ebc2043ad403 req-a8bed2b1-50fe-4e23-88ad-d9ee9c703504 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Deleted volume successfully. Apr 10 10:34:44 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-34c9399b-f809-4856-92e7-ebc2043ad403 req-a8bed2b1-50fe-4e23-88ad-d9ee9c703504 tempest-ServerBootFromVolumeStableRescueTest-1892234984 None] Lock "cinder-21ff4acb-3cc8-43b0-bd76-b3bc0872d7b5-delete_volume" released by "delete_volume" :: held 2.711s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:44 devstack sudo[85146]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0.info" returned: 0 in 0.669s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:44 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:34:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:44 devstack sudo[85156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0.info Apr 10 10:34:44 devstack sudo[85156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:44 devstack sudo[85151]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2cae15b3-2f16-4747-92ad-2227afb52ff1 tempest-GroupsTest-1301316427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c862fe2c-1ae7-4c5d-80be-fad6f271497c" returned: 0 in 0.546s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:44 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-2cae15b3-2f16-4747-92ad-2227afb52ff1 tempest-GroupsTest-1301316427 None] Lock "cinder-quobyte-c862fe2c-1ae7-4c5d-80be-fad6f271497c" released by "delete_volume" :: held 1.402s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:44 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-2cae15b3-2f16-4747-92ad-2227afb52ff1 tempest-GroupsTest-1301316427 None] Created reservations ['6fcccbd0-1d25-4cc5-a64e-758143bc73b4'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:44 devstack cinder-volume[81938]: WARNING cinder.quota [None req-2cae15b3-2f16-4747-92ad-2227afb52ff1 tempest-GroupsTest-1301316427 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-445025161 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-445025161, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:34:44 devstack cinder-volume[81938]: WARNING cinder.quota [None req-2cae15b3-2f16-4747-92ad-2227afb52ff1 tempest-GroupsTest-1301316427 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-445025161 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-445025161, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:34:44 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-2cae15b3-2f16-4747-92ad-2227afb52ff1 tempest-GroupsTest-1301316427 None] Created reservations ['04a760ae-9b8a-45b6-bcba-accec2f6c640', 'b80fdb33-3842-4bdb-84df-71841e6225ea', '2460bcd7-9517-4fde-8850-01423be3dfe3', '84f60af7-3ceb-4792-b3e7-703b2d8c2bb7'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:44 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-2cae15b3-2f16-4747-92ad-2227afb52ff1 tempest-GroupsTest-1301316427 None] Created reservations ['0ef8b733-a992-4c84-9be6-4d26f53cb775', '3b677830-89e2-4a35-8c1b-a45580d1d3aa', 'aa9081b4-9747-47bb-a82f-ff10b768fd09', '2025ab88-c8a6-4481-8a4b-082e583d4ab8'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-2cae15b3-2f16-4747-92ad-2227afb52ff1 tempest-GroupsTest-1301316427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-2cae15b3-2f16-4747-92ad-2227afb52ff1 tempest-GroupsTest-1301316427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:44 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-2cae15b3-2f16-4747-92ad-2227afb52ff1 tempest-GroupsTest-1301316427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:44 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-2cae15b3-2f16-4747-92ad-2227afb52ff1 tempest-GroupsTest-1301316427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-2cae15b3-2f16-4747-92ad-2227afb52ff1 tempest-GroupsTest-1301316427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2cae15b3-2f16-4747-92ad-2227afb52ff1 tempest-GroupsTest-1301316427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:44 devstack sudo[85159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:34:44 devstack sudo[85159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:44 devstack sudo[85156]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0.info" returned: 0 in 0.529s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.263s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:44 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] Creating offline snapshot f493caad-5d73-486d-b68c-814385cf50ee of volume bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7 {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:34:44 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d5e99e-47a2-4d91-b725-4508482c3c16]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:45 devstack sudo[85161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7 Apr 10 10:34:45 devstack sudo[85161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:45 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:34:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Flow 'volume_create_manager' (1c6168b3-8140-451d-b60d-f4c97f8bc275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c25605-ed3a-4dc6-b573-b95ffc1ea538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c25605-ed3a-4dc6-b573-b95ffc1ea538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1555575426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e6cdf4-4548-4adf-b8da-51393a2cc2cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d3945c5cbb04ba3a796c77735250cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:45Z,use_quota=True,user_id='17b259cdbf344bb39d78c8b8037b9fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08d37437-49c8-4ac9-ae22-876c05b82c3b),volume_type_id=08d37437-49c8-4ac9-ae22-876c05b82c3b)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dae7d14-2335-4745-a19b-625b4a56f277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dae7d14-2335-4745-a19b-625b4a56f277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (384433b6-2ac4-49a3-afc5-8b0e69a04120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (384433b6-2ac4-49a3-afc5-8b0e69a04120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9e6cdf4-4548-4adf-b8da-51393a2cc2cb', 'volume_name': 'volume-f9e6cdf4-4548-4adf-b8da-51393a2cc2cb', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6fe71d7-2224-4741-868a-14d9dfea82cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6fe71d7-2224-4741-868a-14d9dfea82cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (217b3fb6-e0eb-4cc6-8a81-1d28990bec24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:45 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Volume f9e6cdf4-4548-4adf-b8da-51393a2cc2cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9e6cdf4-4548-4adf-b8da-51393a2cc2cb', 'volume_size': 1} Apr 10 10:34:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:45 devstack sudo[85159]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2cae15b3-2f16-4747-92ad-2227afb52ff1 tempest-GroupsTest-1301316427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.721s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:45 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-2cae15b3-2f16-4747-92ad-2227afb52ff1 tempest-GroupsTest-1301316427 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:34:45 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-2cae15b3-2f16-4747-92ad-2227afb52ff1 tempest-GroupsTest-1301316427 None] Delete group completed successfully. Apr 10 10:34:45 devstack sudo[85161]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7" returned: 0 in 0.720s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7.f493caad-5d73-486d-b68c-814385cf50ee 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:45 devstack sudo[85167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7.f493caad-5d73-486d-b68c-814385cf50ee 1G Apr 10 10:34:45 devstack sudo[85167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:46 devstack sudo[85167]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7.f493caad-5d73-486d-b68c-814385cf50ee 1G" returned: 0 in 0.636s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7.f493caad-5d73-486d-b68c-814385cf50ee {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:46 devstack sudo[85172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7.f493caad-5d73-486d-b68c-814385cf50ee Apr 10 10:34:46 devstack sudo[85172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:46 devstack sudo[85172]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7.f493caad-5d73-486d-b68c-814385cf50ee" returned: 0 in 0.588s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:46 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7.f493caad-5d73-486d-b68c-814385cf50ee is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:34:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7.f493caad-5d73-486d-b68c-814385cf50ee {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:46 devstack sudo[85202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7.f493caad-5d73-486d-b68c-814385cf50ee Apr 10 10:34:46 devstack sudo[85202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:47 devstack sudo[85202]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7.f493caad-5d73-486d-b68c-814385cf50ee" returned: 0 in 0.659s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:47 devstack sudo[85206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7.info Apr 10 10:34:47 devstack sudo[85206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:48 devstack cinder-volume[81938]: DEBUG oslo_service.periodic_task [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81938) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:34:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:48 devstack sudo[85208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:34:48 devstack sudo[85208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:48 devstack sudo[85206]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7.info" returned: 0 in 0.666s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:48 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:34:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:48 devstack sudo[85211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7.info Apr 10 10:34:48 devstack sudo[85211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:48 devstack sudo[85208]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.711s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:48 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:34:48 devstack sudo[85211]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7.info" returned: 0 in 0.623s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.954s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.402s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1555575426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e6cdf4-4548-4adf-b8da-51393a2cc2cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d3945c5cbb04ba3a796c77735250cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:45Z,use_quota=True,user_id='17b259cdbf344bb39d78c8b8037b9fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08d37437-49c8-4ac9-ae22-876c05b82c3b),volume_type_id=08d37437-49c8-4ac9-ae22-876c05b82c3b)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:34:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Creating volume f9e6cdf4-4548-4adf-b8da-51393a2cc2cb {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:34:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:34:48 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:34:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9e6cdf4-4548-4adf-b8da-51393a2cc2cb 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:48 devstack sudo[85222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9e6cdf4-4548-4adf-b8da-51393a2cc2cb 1073741824 Apr 10 10:34:48 devstack sudo[85222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:49 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-6e8303bf-70db-4c17-b0aa-b7e50f580082 tempest-GroupSnapshotsTest-1740723573 None] group_snapshot 3b6d7d2f-3e1d-4dd7-8233-a3f4a9d3c692: created successfully Apr 10 10:34:49 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] group_snapshot 3b6d7d2f-3e1d-4dd7-8233-a3f4a9d3c692: deleting Apr 10 10:34:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] group_snapshot 3b6d7d2f-3e1d-4dd7-8233-a3f4a9d3c692: deleting {{(pid=81938) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 10 10:34:49 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "cinder-quobyte-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:49 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] Lock "cinder-quobyte-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:49 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "cinder-quobyte-9df28c66-6ae7-4894-835d-57a34f1ffb7d" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:49 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] Lock "cinder-quobyte-9df28c66-6ae7-4894-835d-57a34f1ffb7d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:49 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] Deleting offline snapshot 9df28c66-6ae7-4894-835d-57a34f1ffb7d of volume 2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:34:49 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] snapshot_file for this snap is: volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0.9df28c66-6ae7-4894-835d-57a34f1ffb7d {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:34:49 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede35a37-51bb-4e3e-ae33-109567362697]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0.9df28c66-6ae7-4894-835d-57a34f1ffb7d {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:49 devstack sudo[85224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0.9df28c66-6ae7-4894-835d-57a34f1ffb7d Apr 10 10:34:49 devstack sudo[85224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:49 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-794b09f2-1d5b-401b-8c13-d09f2560b3bd tempest-GroupsV320Test-1626783305 None] Group tempest-GroupsV320Test-Group-58703865: creating Apr 10 10:34:49 devstack sudo[85222]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:49 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-794b09f2-1d5b-401b-8c13-d09f2560b3bd tempest-GroupsV320Test-1626783305 None] Group tempest-GroupsV320Test-Group-58703865: created successfully Apr 10 10:34:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9e6cdf4-4548-4adf-b8da-51393a2cc2cb 1073741824" returned: 0 in 0.744s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:49 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-794b09f2-1d5b-401b-8c13-d09f2560b3bd tempest-GroupsV320Test-1626783305 None] Create group completed successfully. Apr 10 10:34:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9e6cdf4-4548-4adf-b8da-51393a2cc2cb {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:49 devstack sudo[85229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9e6cdf4-4548-4adf-b8da-51393a2cc2cb Apr 10 10:34:49 devstack sudo[85229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:49 devstack sudo[85224]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0.9df28c66-6ae7-4894-835d-57a34f1ffb7d" returned: 0 in 0.657s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:49 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:34:49 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[018f4ee9-986e-4414-b548-48f036de23d6]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:50 devstack sudo[85235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0 Apr 10 10:34:50 devstack sudo[85235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:50 devstack sudo[85229]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9e6cdf4-4548-4adf-b8da-51393a2cc2cb" returned: 0 in 0.540s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:50 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] <== create_volume: return (1318ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:34:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (217b3fb6-e0eb-4cc6-8a81-1d28990bec24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9e6cdf4-4548-4adf-b8da-51393a2cc2cb', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde61101-1b35-4ac7-815b-808bb1067993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:50 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Volume volume-f9e6cdf4-4548-4adf-b8da-51393a2cc2cb (f9e6cdf4-4548-4adf-b8da-51393a2cc2cb): created successfully Apr 10 10:34:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde61101-1b35-4ac7-815b-808bb1067993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Flow 'volume_create_manager' (1c6168b3-8140-451d-b60d-f4c97f8bc275) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:50 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-6359903e-aea5-4c35-a849-9d5a897f0c14 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Created volume successfully. Apr 10 10:34:50 devstack sudo[85235]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0" returned: 0 in 0.598s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0.9df28c66-6ae7-4894-835d-57a34f1ffb7d {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:50 devstack sudo[85241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0.9df28c66-6ae7-4894-835d-57a34f1ffb7d Apr 10 10:34:50 devstack sudo[85241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8d50d7e8-82af-42fc-b5a6-3c8aa708e27c tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8d50d7e8-82af-42fc-b5a6-3c8aa708e27c tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:51 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-8d50d7e8-82af-42fc-b5a6-3c8aa708e27c tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:51 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-8d50d7e8-82af-42fc-b5a6-3c8aa708e27c tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8d50d7e8-82af-42fc-b5a6-3c8aa708e27c tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8d50d7e8-82af-42fc-b5a6-3c8aa708e27c tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:51 devstack sudo[85246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:34:51 devstack sudo[85246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:51 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-e2b5cffe-a5a7-4f1f-97e6-a213c944812d tempest-GroupsV320Test-1626783305 None] Created reservations ['66683909-9b30-4928-8dac-4779fd72c726'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:51 devstack sudo[85241]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0.9df28c66-6ae7-4894-835d-57a34f1ffb7d" returned: 0 in 0.640s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0.9df28c66-6ae7-4894-835d-57a34f1ffb7d {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:51 devstack sudo[85248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0.9df28c66-6ae7-4894-835d-57a34f1ffb7d Apr 10 10:34:51 devstack sudo[85248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e2b5cffe-a5a7-4f1f-97e6-a213c944812d tempest-GroupsV320Test-1626783305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e2b5cffe-a5a7-4f1f-97e6-a213c944812d tempest-GroupsV320Test-1626783305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:51 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e2b5cffe-a5a7-4f1f-97e6-a213c944812d tempest-GroupsV320Test-1626783305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:51 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e2b5cffe-a5a7-4f1f-97e6-a213c944812d tempest-GroupsV320Test-1626783305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e2b5cffe-a5a7-4f1f-97e6-a213c944812d tempest-GroupsV320Test-1626783305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e2b5cffe-a5a7-4f1f-97e6-a213c944812d tempest-GroupsV320Test-1626783305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:51 devstack sudo[85250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:34:51 devstack sudo[85250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:51 devstack sudo[85246]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8d50d7e8-82af-42fc-b5a6-3c8aa708e27c tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.491s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:51 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-8d50d7e8-82af-42fc-b5a6-3c8aa708e27c tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:34:51 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-8d50d7e8-82af-42fc-b5a6-3c8aa708e27c tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Retype volume completed successfully. Apr 10 10:34:51 devstack sudo[85248]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0.9df28c66-6ae7-4894-835d-57a34f1ffb7d" returned: 0 in 0.517s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:51 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] Lock "cinder-quobyte-9df28c66-6ae7-4894-835d-57a34f1ffb7d" released by "_delete_snapshot" :: held 2.477s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:51 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] Lock "cinder-quobyte-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0" released by "delete_snapshot" :: held 2.496s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:51 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "cinder-quobyte-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:51 devstack sudo[85250]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e2b5cffe-a5a7-4f1f-97e6-a213c944812d tempest-GroupsV320Test-1626783305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.517s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:51 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-e2b5cffe-a5a7-4f1f-97e6-a213c944812d tempest-GroupsV320Test-1626783305 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:34:51 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] Lock "cinder-quobyte-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:51 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "cinder-quobyte-f493caad-5d73-486d-b68c-814385cf50ee" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:51 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-e2b5cffe-a5a7-4f1f-97e6-a213c944812d tempest-GroupsV320Test-1626783305 None] Delete group completed successfully. Apr 10 10:34:51 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] Lock "cinder-quobyte-f493caad-5d73-486d-b68c-814385cf50ee" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:51 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] Deleting offline snapshot f493caad-5d73-486d-b68c-814385cf50ee of volume bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:34:51 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] snapshot_file for this snap is: volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7.f493caad-5d73-486d-b68c-814385cf50ee {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:34:51 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2da7c1-5349-4e8f-9b3c-b8f999228271]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7.f493caad-5d73-486d-b68c-814385cf50ee {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:51 devstack sudo[85255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7.f493caad-5d73-486d-b68c-814385cf50ee Apr 10 10:34:51 devstack sudo[85255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:52 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-29c18d52-0b01-493b-b175-232c658aa8e1 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Acquiring lock "cinder-f9e6cdf4-4548-4adf-b8da-51393a2cc2cb-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:52 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-29c18d52-0b01-493b-b175-232c658aa8e1 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Lock "cinder-f9e6cdf4-4548-4adf-b8da-51393a2cc2cb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:52 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-29c18d52-0b01-493b-b175-232c658aa8e1 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Acquiring lock "cinder-quobyte-f9e6cdf4-4548-4adf-b8da-51393a2cc2cb" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:52 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-29c18d52-0b01-493b-b175-232c658aa8e1 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Lock "cinder-quobyte-f9e6cdf4-4548-4adf-b8da-51393a2cc2cb" acquired by "delete_volume" :: waited 0.016s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:52 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a25649-2be1-4e46-803a-9a81aca49abd]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-29c18d52-0b01-493b-b175-232c658aa8e1 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9e6cdf4-4548-4adf-b8da-51393a2cc2cb {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:52 devstack sudo[85260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9e6cdf4-4548-4adf-b8da-51393a2cc2cb Apr 10 10:34:52 devstack sudo[85260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:52 devstack sudo[85255]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7.f493caad-5d73-486d-b68c-814385cf50ee" returned: 0 in 0.757s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:52 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:34:52 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0d809b-41f2-42b6-bfa7-7d93f0cad7cb]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:52 devstack sudo[85262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7 Apr 10 10:34:52 devstack sudo[85262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:53 devstack sudo[85260]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-29c18d52-0b01-493b-b175-232c658aa8e1 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9e6cdf4-4548-4adf-b8da-51393a2cc2cb" returned: 0 in 0.699s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-29c18d52-0b01-493b-b175-232c658aa8e1 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9e6cdf4-4548-4adf-b8da-51393a2cc2cb {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:53 devstack sudo[85268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9e6cdf4-4548-4adf-b8da-51393a2cc2cb Apr 10 10:34:53 devstack sudo[85268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:53 devstack sudo[85262]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7" returned: 0 in 0.870s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7.f493caad-5d73-486d-b68c-814385cf50ee {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:53 devstack sudo[85273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7.f493caad-5d73-486d-b68c-814385cf50ee Apr 10 10:34:53 devstack sudo[85273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:53 devstack sudo[85268]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-29c18d52-0b01-493b-b175-232c658aa8e1 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f9e6cdf4-4548-4adf-b8da-51393a2cc2cb" returned: 0 in 0.561s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:53 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-29c18d52-0b01-493b-b175-232c658aa8e1 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Lock "cinder-quobyte-f9e6cdf4-4548-4adf-b8da-51393a2cc2cb" released by "delete_volume" :: held 1.293s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:53 devstack cinder-volume[81938]: WARNING cinder.quota [None req-29c18d52-0b01-493b-b175-232c658aa8e1 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:34:53 devstack cinder-volume[81938]: WARNING cinder.quota [None req-29c18d52-0b01-493b-b175-232c658aa8e1 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:34:53 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-29c18d52-0b01-493b-b175-232c658aa8e1 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Created reservations ['e98d9cb3-96d9-4069-8d53-9088cae63ae7', 'efec185f-2b90-4ecc-a236-d1e058b0fde0', '5d13a463-1215-4613-bdd4-1f5e89b59948', 'a5b169d8-837b-478a-9516-22762aefef8c'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-29c18d52-0b01-493b-b175-232c658aa8e1 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-29c18d52-0b01-493b-b175-232c658aa8e1 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:53 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-29c18d52-0b01-493b-b175-232c658aa8e1 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:53 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-29c18d52-0b01-493b-b175-232c658aa8e1 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-29c18d52-0b01-493b-b175-232c658aa8e1 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-29c18d52-0b01-493b-b175-232c658aa8e1 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:53 devstack sudo[85277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:34:53 devstack sudo[85277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:54 devstack sudo[85273]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7.f493caad-5d73-486d-b68c-814385cf50ee" returned: 0 in 0.834s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7.f493caad-5d73-486d-b68c-814385cf50ee {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:54 devstack sudo[85283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7.f493caad-5d73-486d-b68c-814385cf50ee Apr 10 10:34:54 devstack sudo[85283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:54 devstack sudo[85277]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-29c18d52-0b01-493b-b175-232c658aa8e1 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.532s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:54 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-29c18d52-0b01-493b-b175-232c658aa8e1 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:34:54 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-29c18d52-0b01-493b-b175-232c658aa8e1 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Deleted volume successfully. Apr 10 10:34:54 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-29c18d52-0b01-493b-b175-232c658aa8e1 tempest-VolumeRetypeWithoutMigrationTest-1396612845 None] Lock "cinder-f9e6cdf4-4548-4adf-b8da-51393a2cc2cb-delete_volume" released by "delete_volume" :: held 2.028s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:54 devstack sudo[85283]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7.f493caad-5d73-486d-b68c-814385cf50ee" returned: 0 in 0.622s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:54 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] Lock "cinder-quobyte-f493caad-5d73-486d-b68c-814385cf50ee" released by "_delete_snapshot" :: held 3.163s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:54 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] Lock "cinder-quobyte-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7" released by "delete_snapshot" :: held 3.184s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:55 devstack cinder-volume[81938]: WARNING cinder.quota [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1566463647 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1566463647, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:34:55 devstack cinder-volume[81938]: WARNING cinder.quota [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1566463647 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1566463647, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:34:55 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] Created reservations ['3dec4550-8988-46e5-a7c2-d407f9d9e0f2', '3812edea-fb32-4a24-8c7a-f9c5bcfa8127', '4c1cbf25-05b9-4a0c-93b5-e78c2ffbf70c', '3ec92036-c30f-4e73-8905-d83e52f46e0b'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:55 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] Created reservations ['112b3f9d-b8ca-44d5-915f-bc31a8de8660', '0f66cfab-3418-4a2a-947b-d48b8e15753f', '84a07e09-a57a-4636-a140-df8d4e784962', '5fd35540-7064-463b-b78a-faa6ad57c1c0'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:55 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-fd065060-1d38-4e14-89a7-8a5894567586 tempest-GroupSnapshotsTest-1740723573 None] group_snapshot 3b6d7d2f-3e1d-4dd7-8233-a3f4a9d3c692: deleted successfully Apr 10 10:34:55 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-19bbfa23-016a-4d92-a854-e3558a17ab48 tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "cinder-quobyte-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:55 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-19bbfa23-016a-4d92-a854-e3558a17ab48 tempest-GroupSnapshotsTest-1740723573 None] Lock "cinder-quobyte-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0" acquired by "delete_volume" :: waited 0.014s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:55 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5a6152-1d1b-41b8-80a2-ff856a8c45c5]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-19bbfa23-016a-4d92-a854-e3558a17ab48 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:56 devstack sudo[85286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0 Apr 10 10:34:56 devstack sudo[85286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:56 devstack sudo[85286]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-19bbfa23-016a-4d92-a854-e3558a17ab48 tempest-GroupSnapshotsTest-1740723573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0" returned: 0 in 0.796s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-19bbfa23-016a-4d92-a854-e3558a17ab48 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:56 devstack sudo[85326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0 Apr 10 10:34:56 devstack sudo[85326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:57 devstack sudo[85326]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-19bbfa23-016a-4d92-a854-e3558a17ab48 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0" returned: 0 in 0.686s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:57 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-19bbfa23-016a-4d92-a854-e3558a17ab48 tempest-GroupSnapshotsTest-1740723573 None] Lock "cinder-quobyte-2db8b86d-3845-4c3d-86f2-ab9e5f58d7d0" released by "delete_volume" :: held 1.535s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:57 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-19bbfa23-016a-4d92-a854-e3558a17ab48 tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "cinder-quobyte-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:57 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-19bbfa23-016a-4d92-a854-e3558a17ab48 tempest-GroupSnapshotsTest-1740723573 None] Lock "cinder-quobyte-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7" acquired by "delete_volume" :: waited 0.014s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:57 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eaf5f24-b437-4884-b159-03dc150b2d53]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-19bbfa23-016a-4d92-a854-e3558a17ab48 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:57 devstack sudo[85329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7 Apr 10 10:34:57 devstack sudo[85329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:58 devstack sudo[85329]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-19bbfa23-016a-4d92-a854-e3558a17ab48 tempest-GroupSnapshotsTest-1740723573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7" returned: 0 in 0.739s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-19bbfa23-016a-4d92-a854-e3558a17ab48 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:58 devstack sudo[85334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7 Apr 10 10:34:58 devstack sudo[85334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:58 devstack sudo[85334]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-19bbfa23-016a-4d92-a854-e3558a17ab48 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7" returned: 0 in 0.622s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:58 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-19bbfa23-016a-4d92-a854-e3558a17ab48 tempest-GroupSnapshotsTest-1740723573 None] Lock "cinder-quobyte-bf75c049-a3e4-4a3d-bc02-c3be2d6f34b7" released by "delete_volume" :: held 1.407s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:58 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-19bbfa23-016a-4d92-a854-e3558a17ab48 tempest-GroupSnapshotsTest-1740723573 None] Created reservations ['abc17975-42e3-4fe3-b6c1-515eaf8c63ef'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:58 devstack cinder-volume[81938]: WARNING cinder.quota [None req-19bbfa23-016a-4d92-a854-e3558a17ab48 tempest-GroupSnapshotsTest-1740723573 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1566463647 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1566463647, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:34:59 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-19bbfa23-016a-4d92-a854-e3558a17ab48 tempest-GroupSnapshotsTest-1740723573 None] Created reservations ['3f9ddf9b-ec54-43d6-8487-d58a0184d6f3', '9df2ad80-05dd-4f08-81a8-b3fbd98f4acd', '9648dc35-9304-4237-89f6-1da2fa4ea467', '00e6f2d6-5d4e-4c59-9abf-6d5c7fc343fd'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:59 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-19bbfa23-016a-4d92-a854-e3558a17ab48 tempest-GroupSnapshotsTest-1740723573 None] Created reservations ['65ae6b04-1fe9-43e0-b833-60be0544d642', '45752a10-958a-4a02-b490-2907a3e199e3', '675d9edb-afaa-483c-869f-d3a03f583ba2', '9084e6bc-eefb-4f42-9d67-80ef908c52df'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-19bbfa23-016a-4d92-a854-e3558a17ab48 tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-19bbfa23-016a-4d92-a854-e3558a17ab48 tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:59 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-19bbfa23-016a-4d92-a854-e3558a17ab48 tempest-GroupSnapshotsTest-1740723573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:59 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-19bbfa23-016a-4d92-a854-e3558a17ab48 tempest-GroupSnapshotsTest-1740723573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-19bbfa23-016a-4d92-a854-e3558a17ab48 tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-19bbfa23-016a-4d92-a854-e3558a17ab48 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:59 devstack sudo[85337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:34:59 devstack sudo[85337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:59 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:34:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] Flow 'volume_create_manager' (aff60e8a-c3a2-40b8-b4a4-009b2fa50a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13eba251-cb69-4cb8-bb94-5060ccc7e256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13eba251-cb69-4cb8-bb94-5060ccc7e256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2002171477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4d2296a-e564-4a07-9788-3115dd66ff16,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='03dc1d5000c744e8aaf5e3baba4297a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:00Z,use_quota=True,user_id='a334ce6b486946649c875e28135e6964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd7d7499-36f2-414c-90b6-3c7372c4345e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd7d7499-36f2-414c-90b6-3c7372c4345e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbedd28c-f385-431c-a29b-5dc3bdce4359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbedd28c-f385-431c-a29b-5dc3bdce4359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4d2296a-e564-4a07-9788-3115dd66ff16', 'volume_name': 'volume-d4d2296a-e564-4a07-9788-3115dd66ff16', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e75fcedf-26b1-4be5-af66-0fea13e25a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e75fcedf-26b1-4be5-af66-0fea13e25a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b50c090-91d4-4df5-b758-3d2496ab7dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:59 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] Volume d4d2296a-e564-4a07-9788-3115dd66ff16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4d2296a-e564-4a07-9788-3115dd66ff16', 'volume_size': 1} Apr 10 10:34:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:59 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2002171477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4d2296a-e564-4a07-9788-3115dd66ff16,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='03dc1d5000c744e8aaf5e3baba4297a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:00Z,use_quota=True,user_id='a334ce6b486946649c875e28135e6964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:34:59 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] Creating volume d4d2296a-e564-4a07-9788-3115dd66ff16 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:34:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:59 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:59 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:59 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:34:59 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:34:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d4d2296a-e564-4a07-9788-3115dd66ff16 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:59 devstack sudo[85339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d4d2296a-e564-4a07-9788-3115dd66ff16 1073741824 Apr 10 10:34:59 devstack sudo[85339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:00 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-9dffc077-b6e5-4e6d-afcf-1cd3caa04d65 tempest-GroupSnapshotsTest-1740723573 None] Group tempest-GroupSnapshotsTest-Group-1886480271: creating Apr 10 10:35:00 devstack sudo[85337]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-19bbfa23-016a-4d92-a854-e3558a17ab48 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.782s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:00 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-19bbfa23-016a-4d92-a854-e3558a17ab48 tempest-GroupSnapshotsTest-1740723573 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:00 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-9dffc077-b6e5-4e6d-afcf-1cd3caa04d65 tempest-GroupSnapshotsTest-1740723573 None] Group tempest-GroupSnapshotsTest-Group-1886480271: created successfully Apr 10 10:35:00 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-19bbfa23-016a-4d92-a854-e3558a17ab48 tempest-GroupSnapshotsTest-1740723573 None] Delete group completed successfully. Apr 10 10:35:00 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-9dffc077-b6e5-4e6d-afcf-1cd3caa04d65 tempest-GroupSnapshotsTest-1740723573 None] Create group completed successfully. Apr 10 10:35:00 devstack sudo[85339]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d4d2296a-e564-4a07-9788-3115dd66ff16 1073741824" returned: 0 in 0.750s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d4d2296a-e564-4a07-9788-3115dd66ff16 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:00 devstack sudo[85346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d4d2296a-e564-4a07-9788-3115dd66ff16 Apr 10 10:35:00 devstack sudo[85346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:01 devstack sudo[85346]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d4d2296a-e564-4a07-9788-3115dd66ff16" returned: 0 in 0.595s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:01 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b50c090-91d4-4df5-b758-3d2496ab7dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4d2296a-e564-4a07-9788-3115dd66ff16', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4c1a7c-d9f1-47ef-b72a-834d9f2b9ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:01 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] Volume volume-d4d2296a-e564-4a07-9788-3115dd66ff16 (d4d2296a-e564-4a07-9788-3115dd66ff16): created successfully Apr 10 10:35:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4c1a7c-d9f1-47ef-b72a-834d9f2b9ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] Flow 'volume_create_manager' (aff60e8a-c3a2-40b8-b4a4-009b2fa50a4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:01 devstack cinder-volume[81938]: INFO cinder.volume.manager [req-bf6c3881-0306-4697-87cb-6a5466f098b2 req-5877ce2b-f11b-4476-b6bf-b695c8168c15 tempest-VolumesGetTestJSON-229711818 None] Created volume successfully. Apr 10 10:35:01 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] Flow 'volume_create_manager' (67e1c7f5-ba08-45ea-bf30-4adda256757b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1136dfc6-517e-47e9-bd97-d9392d794256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1136dfc6-517e-47e9-bd97-d9392d794256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1799498609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aab639a4-8056-4979-98c8-0453f80aaecc,host='devstack@QuobyteHD#QuobyteHD',id=25caa568-b67c-47e6-9990-92343a4ed6d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a15dddae0a2549fba50df6f678735c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:01Z,use_quota=True,user_id='bf543574a01342fb8c6fca09afe3370f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85c03847-e7c3-4688-a49c-6bc133efb072),volume_type_id=85c03847-e7c3-4688-a49c-6bc133efb072)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d77a42af-92e5-4de2-b6ab-bddda68d77c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d77a42af-92e5-4de2-b6ab-bddda68d77c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4656d56-8a94-4b5f-8dbf-b994c6deaad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4656d56-8a94-4b5f-8dbf-b994c6deaad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25caa568-b67c-47e6-9990-92343a4ed6d4', 'volume_name': 'volume-25caa568-b67c-47e6-9990-92343a4ed6d4', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a78aeb-9a01-498a-b9d3-611690cd1bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a78aeb-9a01-498a-b9d3-611690cd1bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6880df2d-e624-4c10-99cf-95bd248cba46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:01 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] Volume 25caa568-b67c-47e6-9990-92343a4ed6d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25caa568-b67c-47e6-9990-92343a4ed6d4', 'volume_size': 1} Apr 10 10:35:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:01 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=aab639a4-8056-4979-98c8-0453f80aaecc,created_at=2026-04-10T08:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1799498609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aab639a4-8056-4979-98c8-0453f80aaecc,host='devstack@QuobyteHD#QuobyteHD',id=25caa568-b67c-47e6-9990-92343a4ed6d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a15dddae0a2549fba50df6f678735c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:01Z,use_quota=True,user_id='bf543574a01342fb8c6fca09afe3370f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85c03847-e7c3-4688-a49c-6bc133efb072),volume_type_id=85c03847-e7c3-4688-a49c-6bc133efb072)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:01 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] Creating volume 25caa568-b67c-47e6-9990-92343a4ed6d4 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:01 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:01 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:01 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:01 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:35:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:01 devstack sudo[85349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4 1073741824 Apr 10 10:35:01 devstack sudo[85349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:02 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-9ab1000b-0d72-4ea2-b671-123cd779be06 req-8ed52fe5-bcff-4d18-b721-5f59a68dfaa9 tempest-VolumesGetTestJSON-229711818 None] Acquiring lock "cinder-d4d2296a-e564-4a07-9788-3115dd66ff16-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:02 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-9ab1000b-0d72-4ea2-b671-123cd779be06 req-8ed52fe5-bcff-4d18-b721-5f59a68dfaa9 tempest-VolumesGetTestJSON-229711818 None] Lock "cinder-d4d2296a-e564-4a07-9788-3115dd66ff16-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:02 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-9ab1000b-0d72-4ea2-b671-123cd779be06 req-8ed52fe5-bcff-4d18-b721-5f59a68dfaa9 tempest-VolumesGetTestJSON-229711818 None] Acquiring lock "cinder-quobyte-d4d2296a-e564-4a07-9788-3115dd66ff16" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:02 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-9ab1000b-0d72-4ea2-b671-123cd779be06 req-8ed52fe5-bcff-4d18-b721-5f59a68dfaa9 tempest-VolumesGetTestJSON-229711818 None] Lock "cinder-quobyte-d4d2296a-e564-4a07-9788-3115dd66ff16" acquired by "delete_volume" :: waited 0.024s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:02 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b946ed-ef76-40c5-ab46-eca4f375ad11]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-9ab1000b-0d72-4ea2-b671-123cd779be06 req-8ed52fe5-bcff-4d18-b721-5f59a68dfaa9 tempest-VolumesGetTestJSON-229711818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d4d2296a-e564-4a07-9788-3115dd66ff16 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:02 devstack sudo[85349]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4 1073741824" returned: 0 in 0.879s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:02 devstack sudo[85355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4 Apr 10 10:35:02 devstack sudo[85355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:02 devstack sudo[85354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d4d2296a-e564-4a07-9788-3115dd66ff16 Apr 10 10:35:02 devstack sudo[85354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:03 devstack sudo[85355]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4" returned: 0 in 0.693s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:03 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:03 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6880df2d-e624-4c10-99cf-95bd248cba46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25caa568-b67c-47e6-9990-92343a4ed6d4', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:03 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81ccc9fb-efdb-4845-8866-e944504275e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:03 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] Volume volume-25caa568-b67c-47e6-9990-92343a4ed6d4 (25caa568-b67c-47e6-9990-92343a4ed6d4): created successfully Apr 10 10:35:03 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81ccc9fb-efdb-4845-8866-e944504275e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:03 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] Flow 'volume_create_manager' (67e1c7f5-ba08-45ea-bf30-4adda256757b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:03 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-ee690b25-dfad-4ed5-9b9b-9a28d6634e95 tempest-GroupSnapshotsTest-1740723573 None] Created volume successfully. Apr 10 10:35:03 devstack sudo[85354]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-9ab1000b-0d72-4ea2-b671-123cd779be06 req-8ed52fe5-bcff-4d18-b721-5f59a68dfaa9 tempest-VolumesGetTestJSON-229711818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d4d2296a-e564-4a07-9788-3115dd66ff16" returned: 0 in 0.806s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-9ab1000b-0d72-4ea2-b671-123cd779be06 req-8ed52fe5-bcff-4d18-b721-5f59a68dfaa9 tempest-VolumesGetTestJSON-229711818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d4d2296a-e564-4a07-9788-3115dd66ff16 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:03 devstack sudo[85362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d4d2296a-e564-4a07-9788-3115dd66ff16 Apr 10 10:35:03 devstack sudo[85362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:03 devstack sudo[85362]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-9ab1000b-0d72-4ea2-b671-123cd779be06 req-8ed52fe5-bcff-4d18-b721-5f59a68dfaa9 tempest-VolumesGetTestJSON-229711818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d4d2296a-e564-4a07-9788-3115dd66ff16" returned: 0 in 0.527s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:03 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-9ab1000b-0d72-4ea2-b671-123cd779be06 req-8ed52fe5-bcff-4d18-b721-5f59a68dfaa9 tempest-VolumesGetTestJSON-229711818 None] Lock "cinder-quobyte-d4d2296a-e564-4a07-9788-3115dd66ff16" released by "delete_volume" :: held 1.370s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:03 devstack cinder-volume[81938]: DEBUG cinder.quota [req-9ab1000b-0d72-4ea2-b671-123cd779be06 req-8ed52fe5-bcff-4d18-b721-5f59a68dfaa9 tempest-VolumesGetTestJSON-229711818 None] Created reservations ['62f01862-3ca7-4b54-8426-e9b79435973c', '09d5f62a-24e0-44a9-bf0f-e69947136bc5', 'a237a8c7-29a9-42ef-a8e6-13f9175cb451', 'a1bd8246-f582-433a-ae4f-c2067fa7ef30'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-9ab1000b-0d72-4ea2-b671-123cd779be06 req-8ed52fe5-bcff-4d18-b721-5f59a68dfaa9 tempest-VolumesGetTestJSON-229711818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-9ab1000b-0d72-4ea2-b671-123cd779be06 req-8ed52fe5-bcff-4d18-b721-5f59a68dfaa9 tempest-VolumesGetTestJSON-229711818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:03 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [req-9ab1000b-0d72-4ea2-b671-123cd779be06 req-8ed52fe5-bcff-4d18-b721-5f59a68dfaa9 tempest-VolumesGetTestJSON-229711818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:03 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [req-9ab1000b-0d72-4ea2-b671-123cd779be06 req-8ed52fe5-bcff-4d18-b721-5f59a68dfaa9 tempest-VolumesGetTestJSON-229711818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [req-9ab1000b-0d72-4ea2-b671-123cd779be06 req-8ed52fe5-bcff-4d18-b721-5f59a68dfaa9 tempest-VolumesGetTestJSON-229711818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-9ab1000b-0d72-4ea2-b671-123cd779be06 req-8ed52fe5-bcff-4d18-b721-5f59a68dfaa9 tempest-VolumesGetTestJSON-229711818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:03 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-19e97a10-c0a5-4b5c-9378-7e05f034d50e tempest-GroupSnapshotsTest-1740723573 None] GroupSnapshot 75a39390-0fe3-4e93-86bf-d4e7b643d3e9: creating. Apr 10 10:35:03 devstack sudo[85365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:35:04 devstack sudo[85365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:04 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-19e97a10-c0a5-4b5c-9378-7e05f034d50e tempest-GroupSnapshotsTest-1740723573 None] Group snapshot 75a39390-0fe3-4e93-86bf-d4e7b643d3e9: creating. {{(pid=81938) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 10 10:35:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-19e97a10-c0a5-4b5c-9378-7e05f034d50e tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-19e97a10-c0a5-4b5c-9378-7e05f034d50e tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:04 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-19e97a10-c0a5-4b5c-9378-7e05f034d50e tempest-GroupSnapshotsTest-1740723573 None] Creating offline snapshot 551c7e60-6e9b-445a-ad0d-bf8b365dd4b8 of volume 25caa568-b67c-47e6-9990-92343a4ed6d4 {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:35:04 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[8347a862-ed5c-47b9-abf1-4b8b4c7b0ac0]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-19e97a10-c0a5-4b5c-9378-7e05f034d50e tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:04 devstack sudo[85367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4 Apr 10 10:35:04 devstack sudo[85367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:04 devstack sudo[85365]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [req-9ab1000b-0d72-4ea2-b671-123cd779be06 req-8ed52fe5-bcff-4d18-b721-5f59a68dfaa9 tempest-VolumesGetTestJSON-229711818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.661s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:04 devstack cinder-volume[81938]: DEBUG cinder.manager [req-9ab1000b-0d72-4ea2-b671-123cd779be06 req-8ed52fe5-bcff-4d18-b721-5f59a68dfaa9 tempest-VolumesGetTestJSON-229711818 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:04 devstack cinder-volume[81938]: INFO cinder.volume.manager [req-9ab1000b-0d72-4ea2-b671-123cd779be06 req-8ed52fe5-bcff-4d18-b721-5f59a68dfaa9 tempest-VolumesGetTestJSON-229711818 None] Deleted volume successfully. Apr 10 10:35:04 devstack cinder-volume[81938]: DEBUG cinder.coordination [req-9ab1000b-0d72-4ea2-b671-123cd779be06 req-8ed52fe5-bcff-4d18-b721-5f59a68dfaa9 tempest-VolumesGetTestJSON-229711818 None] Lock "cinder-d4d2296a-e564-4a07-9788-3115dd66ff16-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:04 devstack sudo[85367]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-19e97a10-c0a5-4b5c-9378-7e05f034d50e tempest-GroupSnapshotsTest-1740723573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4" returned: 0 in 0.632s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-19e97a10-c0a5-4b5c-9378-7e05f034d50e tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4.551c7e60-6e9b-445a-ad0d-bf8b365dd4b8 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:04 devstack sudo[85373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4.551c7e60-6e9b-445a-ad0d-bf8b365dd4b8 1G Apr 10 10:35:04 devstack sudo[85373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:05 devstack sudo[85373]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-19e97a10-c0a5-4b5c-9378-7e05f034d50e tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4.551c7e60-6e9b-445a-ad0d-bf8b365dd4b8 1G" returned: 0 in 0.737s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-19e97a10-c0a5-4b5c-9378-7e05f034d50e tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25caa568-b67c-47e6-9990-92343a4ed6d4 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4.551c7e60-6e9b-445a-ad0d-bf8b365dd4b8 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:05 devstack sudo[85378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25caa568-b67c-47e6-9990-92343a4ed6d4 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4.551c7e60-6e9b-445a-ad0d-bf8b365dd4b8 Apr 10 10:35:05 devstack sudo[85378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:06 devstack sudo[85378]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-19e97a10-c0a5-4b5c-9378-7e05f034d50e tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25caa568-b67c-47e6-9990-92343a4ed6d4 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4.551c7e60-6e9b-445a-ad0d-bf8b365dd4b8" returned: 0 in 0.681s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:06 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-19e97a10-c0a5-4b5c-9378-7e05f034d50e tempest-GroupSnapshotsTest-1740723573 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4.551c7e60-6e9b-445a-ad0d-bf8b365dd4b8 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:35:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-19e97a10-c0a5-4b5c-9378-7e05f034d50e tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4.551c7e60-6e9b-445a-ad0d-bf8b365dd4b8 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:06 devstack sudo[85383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4.551c7e60-6e9b-445a-ad0d-bf8b365dd4b8 Apr 10 10:35:06 devstack sudo[85383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:06 devstack sudo[85383]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-19e97a10-c0a5-4b5c-9378-7e05f034d50e tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4.551c7e60-6e9b-445a-ad0d-bf8b365dd4b8" returned: 0 in 0.560s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-19e97a10-c0a5-4b5c-9378-7e05f034d50e tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:06 devstack sudo[85387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4.info Apr 10 10:35:06 devstack sudo[85387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:07 devstack sudo[85387]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-19e97a10-c0a5-4b5c-9378-7e05f034d50e tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4.info" returned: 0 in 0.539s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:07 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-19e97a10-c0a5-4b5c-9378-7e05f034d50e tempest-GroupSnapshotsTest-1740723573 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:35:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-19e97a10-c0a5-4b5c-9378-7e05f034d50e tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:07 devstack sudo[85390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4.info Apr 10 10:35:07 devstack sudo[85390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:07 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] Flow 'volume_create_manager' (a429d616-f464-4f36-a7cb-236bd3ae429a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86616047-9b32-4c9b-bbe4-0417a75eee26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86616047-9b32-4c9b-bbe4-0417a75eee26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2026736476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d40175-938a-4af5-a280-517d27823570,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ddd2d918514949ff94b31c069e778d9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:08Z,use_quota=True,user_id='1b58326f0b8440faacfbf3c5be03f256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287adbf8-37fe-4fd8-948e-30d519a000b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287adbf8-37fe-4fd8-948e-30d519a000b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b6e8c7f-f63c-489a-9424-9e0b1ce03121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b6e8c7f-f63c-489a-9424-9e0b1ce03121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9d40175-938a-4af5-a280-517d27823570', 'volume_name': 'volume-e9d40175-938a-4af5-a280-517d27823570', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (029d7375-85f5-4b5c-8b06-20cfc91e2099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (029d7375-85f5-4b5c-8b06-20cfc91e2099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78db636d-fcee-4637-9b5f-a4f21b895b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:07 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] Volume e9d40175-938a-4af5-a280-517d27823570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9d40175-938a-4af5-a280-517d27823570', 'volume_size': 1} Apr 10 10:35:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:07 devstack sudo[85390]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-19e97a10-c0a5-4b5c-9378-7e05f034d50e tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4.info" returned: 0 in 0.576s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-19e97a10-c0a5-4b5c-9378-7e05f034d50e tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.798s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.065s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2026736476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d40175-938a-4af5-a280-517d27823570,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ddd2d918514949ff94b31c069e778d9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:08Z,use_quota=True,user_id='1b58326f0b8440faacfbf3c5be03f256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] Creating volume e9d40175-938a-4af5-a280-517d27823570 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:07 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:35:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e9d40175-938a-4af5-a280-517d27823570 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:07 devstack sudo[85393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e9d40175-938a-4af5-a280-517d27823570 1073741824 Apr 10 10:35:07 devstack sudo[85393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:07 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-19e97a10-c0a5-4b5c-9378-7e05f034d50e tempest-GroupSnapshotsTest-1740723573 None] group_snapshot 75a39390-0fe3-4e93-86bf-d4e7b643d3e9: created successfully Apr 10 10:35:08 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-79bbeba5-0011-4c1e-849f-ef089b25259a tempest-GroupSnapshotsTest-1740723573 None] group_snapshot 75a39390-0fe3-4e93-86bf-d4e7b643d3e9: deleting Apr 10 10:35:08 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-79bbeba5-0011-4c1e-849f-ef089b25259a tempest-GroupSnapshotsTest-1740723573 None] group_snapshot 75a39390-0fe3-4e93-86bf-d4e7b643d3e9: deleting {{(pid=81938) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 10 10:35:08 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-79bbeba5-0011-4c1e-849f-ef089b25259a tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "cinder-quobyte-25caa568-b67c-47e6-9990-92343a4ed6d4" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:08 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-79bbeba5-0011-4c1e-849f-ef089b25259a tempest-GroupSnapshotsTest-1740723573 None] Lock "cinder-quobyte-25caa568-b67c-47e6-9990-92343a4ed6d4" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:08 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-79bbeba5-0011-4c1e-849f-ef089b25259a tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "cinder-quobyte-551c7e60-6e9b-445a-ad0d-bf8b365dd4b8" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:08 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-79bbeba5-0011-4c1e-849f-ef089b25259a tempest-GroupSnapshotsTest-1740723573 None] Lock "cinder-quobyte-551c7e60-6e9b-445a-ad0d-bf8b365dd4b8" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:08 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-79bbeba5-0011-4c1e-849f-ef089b25259a tempest-GroupSnapshotsTest-1740723573 None] Deleting offline snapshot 551c7e60-6e9b-445a-ad0d-bf8b365dd4b8 of volume 25caa568-b67c-47e6-9990-92343a4ed6d4 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:35:08 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-79bbeba5-0011-4c1e-849f-ef089b25259a tempest-GroupSnapshotsTest-1740723573 None] snapshot_file for this snap is: volume-25caa568-b67c-47e6-9990-92343a4ed6d4.551c7e60-6e9b-445a-ad0d-bf8b365dd4b8 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:35:08 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d0b21e-9731-4fd6-8159-161df231ec60]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-79bbeba5-0011-4c1e-849f-ef089b25259a tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4.551c7e60-6e9b-445a-ad0d-bf8b365dd4b8 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:08 devstack sudo[85393]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e9d40175-938a-4af5-a280-517d27823570 1073741824" returned: 0 in 0.676s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e9d40175-938a-4af5-a280-517d27823570 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:08 devstack sudo[85398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4.551c7e60-6e9b-445a-ad0d-bf8b365dd4b8 Apr 10 10:35:08 devstack sudo[85398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:08 devstack sudo[85399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e9d40175-938a-4af5-a280-517d27823570 Apr 10 10:35:08 devstack sudo[85399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:09 devstack sudo[85399]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] Flow 'volume_create_manager' (7adc2b0a-5513-4904-99ba-994c7768b38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f23ec7f0-b0b4-48c2-b194-df801c898551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f23ec7f0-b0b4-48c2-b194-df801c898551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-382024452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfae1d99-b962-438f-9364-fc2a86e73b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baea770816584a4084eca0081a8815c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:09Z,use_quota=True,user_id='d97b15b0e30d4d90a5b4d356b5dcf324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f62ff1-786b-4295-9925-8c18bc257492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f62ff1-786b-4295-9925-8c18bc257492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59773c97-a400-4a9d-b135-83f41c6e7f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59773c97-a400-4a9d-b135-83f41c6e7f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfae1d99-b962-438f-9364-fc2a86e73b66', 'volume_name': 'volume-cfae1d99-b962-438f-9364-fc2a86e73b66', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c95a3863-e956-4dcf-9ace-fd8777ec4b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c95a3863-e956-4dcf-9ace-fd8777ec4b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4582415b-41b1-45f4-8cec-d5620345d3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:09 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] Volume cfae1d99-b962-438f-9364-fc2a86e73b66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfae1d99-b962-438f-9364-fc2a86e73b66', 'volume_size': 1} Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e9d40175-938a-4af5-a280-517d27823570" returned: 0 in 0.617s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-382024452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfae1d99-b962-438f-9364-fc2a86e73b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baea770816584a4084eca0081a8815c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:09Z,use_quota=True,user_id='d97b15b0e30d4d90a5b4d356b5dcf324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] Creating volume cfae1d99-b962-438f-9364-fc2a86e73b66 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:09 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cfae1d99-b962-438f-9364-fc2a86e73b66 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:09 devstack sudo[85398]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78db636d-fcee-4637-9b5f-a4f21b895b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9d40175-938a-4af5-a280-517d27823570', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b4af9fa-f2ae-4e99-9b15-c6eead4fc1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:09 devstack sudo[85406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cfae1d99-b962-438f-9364-fc2a86e73b66 1073741824 Apr 10 10:35:09 devstack sudo[85406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-79bbeba5-0011-4c1e-849f-ef089b25259a tempest-GroupSnapshotsTest-1740723573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4.551c7e60-6e9b-445a-ad0d-bf8b365dd4b8" returned: 0 in 0.726s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-79bbeba5-0011-4c1e-849f-ef089b25259a tempest-GroupSnapshotsTest-1740723573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25caa568-b67c-47e6-9990-92343a4ed6d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:35:09 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] Volume volume-e9d40175-938a-4af5-a280-517d27823570 (e9d40175-938a-4af5-a280-517d27823570): created successfully Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b4af9fa-f2ae-4e99-9b15-c6eead4fc1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] Flow 'volume_create_manager' (a429d616-f464-4f36-a7cb-236bd3ae429a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43ca42d-4d9a-424a-8d6d-0cd892ef9f24]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-79bbeba5-0011-4c1e-849f-ef089b25259a tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:09 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-f3db70f6-a6e7-41c5-b6a4-d7703e00304f tempest-VolumesTestJSON-209053586 None] Created volume successfully. Apr 10 10:35:09 devstack sudo[85408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4 Apr 10 10:35:09 devstack sudo[85408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:09 devstack sudo[85406]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cfae1d99-b962-438f-9364-fc2a86e73b66 1073741824" returned: 0 in 0.580s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cfae1d99-b962-438f-9364-fc2a86e73b66 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:09 devstack sudo[85416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cfae1d99-b962-438f-9364-fc2a86e73b66 Apr 10 10:35:09 devstack sudo[85416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:09 devstack sudo[85408]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-79bbeba5-0011-4c1e-849f-ef089b25259a tempest-GroupSnapshotsTest-1740723573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4" returned: 0 in 0.572s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-79bbeba5-0011-4c1e-849f-ef089b25259a tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4.551c7e60-6e9b-445a-ad0d-bf8b365dd4b8 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:09 devstack sudo[85418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4.551c7e60-6e9b-445a-ad0d-bf8b365dd4b8 Apr 10 10:35:09 devstack sudo[85418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] Flow 'volume_create_manager' (db4a3ba2-3d16-4764-b919-f6e9648ca34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17265fa1-54f5-461f-8926-2c682db6a681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17265fa1-54f5-461f-8926-2c682db6a681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-811286712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b73e9a9a-033d-43a7-8cb1-915779805083,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ddd2d918514949ff94b31c069e778d9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:10Z,use_quota=True,user_id='1b58326f0b8440faacfbf3c5be03f256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b93a5377-1296-4749-8f8d-9c59e0652577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b93a5377-1296-4749-8f8d-9c59e0652577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (022020cd-6392-4231-ba36-20f0dbb2ea51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (022020cd-6392-4231-ba36-20f0dbb2ea51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b73e9a9a-033d-43a7-8cb1-915779805083', 'volume_name': 'volume-b73e9a9a-033d-43a7-8cb1-915779805083', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aebc67f-8cb0-466b-9dfe-762c32fd50c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aebc67f-8cb0-466b-9dfe-762c32fd50c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7cfcc57-b18c-4bae-a00d-7ed70a3631e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:10 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] Volume b73e9a9a-033d-43a7-8cb1-915779805083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b73e9a9a-033d-43a7-8cb1-915779805083', 'volume_size': 1} Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:10 devstack sudo[85416]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cfae1d99-b962-438f-9364-fc2a86e73b66" returned: 0 in 0.649s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.087s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-811286712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b73e9a9a-033d-43a7-8cb1-915779805083,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ddd2d918514949ff94b31c069e778d9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:10Z,use_quota=True,user_id='1b58326f0b8440faacfbf3c5be03f256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] Creating volume b73e9a9a-033d-43a7-8cb1-915779805083 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:10 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b73e9a9a-033d-43a7-8cb1-915779805083 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:10 devstack sudo[85418]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-79bbeba5-0011-4c1e-849f-ef089b25259a tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4.551c7e60-6e9b-445a-ad0d-bf8b365dd4b8" returned: 0 in 0.648s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-79bbeba5-0011-4c1e-849f-ef089b25259a tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4.551c7e60-6e9b-445a-ad0d-bf8b365dd4b8 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:10 devstack sudo[85425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b73e9a9a-033d-43a7-8cb1-915779805083 1073741824 Apr 10 10:35:10 devstack sudo[85425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4582415b-41b1-45f4-8cec-d5620345d3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfae1d99-b962-438f-9364-fc2a86e73b66', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0519240e-f966-403f-b24b-f7f2daf69617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:10 devstack sudo[85426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4.551c7e60-6e9b-445a-ad0d-bf8b365dd4b8 Apr 10 10:35:10 devstack sudo[85426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:10 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] Volume volume-cfae1d99-b962-438f-9364-fc2a86e73b66 (cfae1d99-b962-438f-9364-fc2a86e73b66): created successfully Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0519240e-f966-403f-b24b-f7f2daf69617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] Flow 'volume_create_manager' (7adc2b0a-5513-4904-99ba-994c7768b38a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:10 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-e5c280f2-6a6a-455b-ac63-a446226a553d tempest-VolumesListAdminTestJSON-477560451 None] Created volume successfully. Apr 10 10:35:10 devstack sudo[85426]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-79bbeba5-0011-4c1e-849f-ef089b25259a tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4.551c7e60-6e9b-445a-ad0d-bf8b365dd4b8" returned: 0 in 0.546s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-79bbeba5-0011-4c1e-849f-ef089b25259a tempest-GroupSnapshotsTest-1740723573 None] Lock "cinder-quobyte-551c7e60-6e9b-445a-ad0d-bf8b365dd4b8" released by "_delete_snapshot" :: held 2.578s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-79bbeba5-0011-4c1e-849f-ef089b25259a tempest-GroupSnapshotsTest-1740723573 None] Lock "cinder-quobyte-25caa568-b67c-47e6-9990-92343a4ed6d4" released by "delete_snapshot" :: held 2.595s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:11 devstack cinder-volume[81938]: WARNING cinder.quota [None req-79bbeba5-0011-4c1e-849f-ef089b25259a tempest-GroupSnapshotsTest-1740723573 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2130080916 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2130080916, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:35:11 devstack cinder-volume[81938]: WARNING cinder.quota [None req-79bbeba5-0011-4c1e-849f-ef089b25259a tempest-GroupSnapshotsTest-1740723573 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2130080916 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2130080916, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-79bbeba5-0011-4c1e-849f-ef089b25259a tempest-GroupSnapshotsTest-1740723573 None] Created reservations ['92a2afa4-bbb5-496f-8aeb-535fba6b83a4', '3e5f4aca-f4c3-42a6-ac81-5b741e2678e3', '5f3aea9a-1710-452e-9858-7af602909d00', '37c5e2b0-e9e8-444e-8137-6fc18c29a43c'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:11 devstack sudo[85425]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b73e9a9a-033d-43a7-8cb1-915779805083 1073741824" returned: 0 in 0.738s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:11 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-79bbeba5-0011-4c1e-849f-ef089b25259a tempest-GroupSnapshotsTest-1740723573 None] group_snapshot 75a39390-0fe3-4e93-86bf-d4e7b643d3e9: deleted successfully Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b73e9a9a-033d-43a7-8cb1-915779805083 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:11 devstack sudo[85433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b73e9a9a-033d-43a7-8cb1-915779805083 Apr 10 10:35:11 devstack sudo[85433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] Flow 'volume_create_manager' (abda4b4e-f4d8-4395-b806-0174ee375256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b01791-6d16-4a85-8e91-b0476b19839d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b01791-6d16-4a85-8e91-b0476b19839d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1205228939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c9cc1c3-68ce-4acd-b806-1eb7581dd07a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baea770816584a4084eca0081a8815c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:11Z,use_quota=True,user_id='d97b15b0e30d4d90a5b4d356b5dcf324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bdc2a74-3815-4d37-a781-ce86a8f9bda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bdc2a74-3815-4d37-a781-ce86a8f9bda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031b19d8-be44-4b84-902c-ed540aef6f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031b19d8-be44-4b84-902c-ed540aef6f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c9cc1c3-68ce-4acd-b806-1eb7581dd07a', 'volume_name': 'volume-7c9cc1c3-68ce-4acd-b806-1eb7581dd07a', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7172eb5-322b-4351-9aa0-fcb70e1ba23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7172eb5-322b-4351-9aa0-fcb70e1ba23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f83e5b-2712-476e-a5cf-1997a3a4b254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:11 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] Volume 7c9cc1c3-68ce-4acd-b806-1eb7581dd07a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c9cc1c3-68ce-4acd-b806-1eb7581dd07a', 'volume_size': 1} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Flow 'volume_create_manager' (fdd9e11d-1720-4944-ada5-879a58cbf710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef5e5405-8f85-4279-9cfe-1f34073e9b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef5e5405-8f85-4279-9cfe-1f34073e9b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1042690299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61303216-2346-495f-a435-25a6c2b300d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9902cfda22114837841dbc091a8c9d96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:12Z,use_quota=True,user_id='7f7a2ded6b534e7bb91844320cfbc6c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76e1264d-d34a-432a-9e54-41a66975359c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76e1264d-d34a-432a-9e54-41a66975359c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a417fcae-35c6-47df-b4c8-78a944eb4be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a417fcae-35c6-47df-b4c8-78a944eb4be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61303216-2346-495f-a435-25a6c2b300d3', 'volume_name': 'volume-61303216-2346-495f-a435-25a6c2b300d3', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e1b7930-dbc4-4c29-8865-c7acc5b33040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e1b7930-dbc4-4c29-8865-c7acc5b33040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a689a795-f891-4279-966f-80359a88fce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:11 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Volume 61303216-2346-495f-a435-25a6c2b300d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61303216-2346-495f-a435-25a6c2b300d3', 'volume_size': 1} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:11 devstack sudo[85433]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b73e9a9a-033d-43a7-8cb1-915779805083" returned: 0 in 0.535s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.187s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1205228939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c9cc1c3-68ce-4acd-b806-1eb7581dd07a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baea770816584a4084eca0081a8815c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:11Z,use_quota=True,user_id='d97b15b0e30d4d90a5b4d356b5dcf324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] Creating volume 7c9cc1c3-68ce-4acd-b806-1eb7581dd07a {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:11 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7c9cc1c3-68ce-4acd-b806-1eb7581dd07a 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7cfcc57-b18c-4bae-a00d-7ed70a3631e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b73e9a9a-033d-43a7-8cb1-915779805083', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:11 devstack sudo[85436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7c9cc1c3-68ce-4acd-b806-1eb7581dd07a 1073741824 Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e3a7cb-0372-4329-bd8d-623de1f29b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:11 devstack sudo[85436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:11 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] Volume volume-b73e9a9a-033d-43a7-8cb1-915779805083 (b73e9a9a-033d-43a7-8cb1-915779805083): created successfully Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e3a7cb-0372-4329-bd8d-623de1f29b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] Flow 'volume_create_manager' (db4a3ba2-3d16-4764-b919-f6e9648ca34b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:11 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-5f214197-e5eb-4391-b8ee-29bdeeafe7a6 tempest-VolumesTestJSON-209053586 None] Created volume successfully. Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-1a63ecc9-6561-45ea-b1d4-b0810c658549 tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "cinder-quobyte-25caa568-b67c-47e6-9990-92343a4ed6d4" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-1a63ecc9-6561-45ea-b1d4-b0810c658549 tempest-GroupSnapshotsTest-1740723573 None] Lock "cinder-quobyte-25caa568-b67c-47e6-9990-92343a4ed6d4" acquired by "delete_volume" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cabe7ce-f890-4de6-bb32-dcdbecdcecf1]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1a63ecc9-6561-45ea-b1d4-b0810c658549 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:11 devstack sudo[85438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4 Apr 10 10:35:11 devstack sudo[85438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:12 devstack sudo[85436]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7c9cc1c3-68ce-4acd-b806-1eb7581dd07a 1073741824" returned: 0 in 0.591s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7c9cc1c3-68ce-4acd-b806-1eb7581dd07a {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:12 devstack sudo[85447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7c9cc1c3-68ce-4acd-b806-1eb7581dd07a Apr 10 10:35:12 devstack sudo[85447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:12 devstack sudo[85438]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1a63ecc9-6561-45ea-b1d4-b0810c658549 tempest-GroupSnapshotsTest-1740723573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4" returned: 0 in 0.591s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1a63ecc9-6561-45ea-b1d4-b0810c658549 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:12 devstack sudo[85449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4 Apr 10 10:35:12 devstack sudo[85449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] Flow 'volume_create_manager' (35c91978-4113-4172-b74f-7c2212705909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:12 devstack sudo[85447]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84812d8b-f79f-4cdb-8366-43a176b439b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84812d8b-f79f-4cdb-8366-43a176b439b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-155417899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64471c66-be81-42a3-89dc-f68d5a81351a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ddd2d918514949ff94b31c069e778d9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:13Z,use_quota=True,user_id='1b58326f0b8440faacfbf3c5be03f256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01268c02-c3d3-49e2-9513-4f0757d92e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01268c02-c3d3-49e2-9513-4f0757d92e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8de6d030-c4f4-4577-a964-490d417da866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8de6d030-c4f4-4577-a964-490d417da866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64471c66-be81-42a3-89dc-f68d5a81351a', 'volume_name': 'volume-64471c66-be81-42a3-89dc-f68d5a81351a', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (611660a4-9eb8-4db7-ac15-3e54272a63df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (611660a4-9eb8-4db7-ac15-3e54272a63df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58eaeac3-c58e-4267-a0eb-a99a153e6396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:12 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] Volume 64471c66-be81-42a3-89dc-f68d5a81351a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64471c66-be81-42a3-89dc-f68d5a81351a', 'volume_size': 1} Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7c9cc1c3-68ce-4acd-b806-1eb7581dd07a" returned: 0 in 0.580s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.322s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1042690299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61303216-2346-495f-a435-25a6c2b300d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9902cfda22114837841dbc091a8c9d96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:12Z,use_quota=True,user_id='7f7a2ded6b534e7bb91844320cfbc6c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Creating volume 61303216-2346-495f-a435-25a6c2b300d3 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:12 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-61303216-2346-495f-a435-25a6c2b300d3 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writing DB stats cinder:SELECT=217,cinder:UPDATE=215,cinder:DELETE=12,cinder:INSERT=59 {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f83e5b-2712-476e-a5cf-1997a3a4b254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c9cc1c3-68ce-4acd-b806-1eb7581dd07a', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:12 devstack sudo[85453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-61303216-2346-495f-a435-25a6c2b300d3 1073741824 Apr 10 10:35:12 devstack sudo[85453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a84b974-68c7-4e98-9d36-aed4555a8985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:12 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writing DB stats cinder:SELECT=235,cinder:INSERT=51,cinder:UPDATE=259,cinder:DELETE=8 {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:35:13 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] Volume volume-7c9cc1c3-68ce-4acd-b806-1eb7581dd07a (7c9cc1c3-68ce-4acd-b806-1eb7581dd07a): created successfully Apr 10 10:35:13 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a84b974-68c7-4e98-9d36-aed4555a8985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:13 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] Flow 'volume_create_manager' (abda4b4e-f4d8-4395-b806-0174ee375256) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:13 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-d09c6eab-4e9d-4c88-ba3f-0f5c744e6c74 tempest-VolumesListAdminTestJSON-477560451 None] Created volume successfully. Apr 10 10:35:13 devstack sudo[85449]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1a63ecc9-6561-45ea-b1d4-b0810c658549 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-25caa568-b67c-47e6-9990-92343a4ed6d4" returned: 0 in 0.582s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:13 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-1a63ecc9-6561-45ea-b1d4-b0810c658549 tempest-GroupSnapshotsTest-1740723573 None] Lock "cinder-quobyte-25caa568-b67c-47e6-9990-92343a4ed6d4" released by "delete_volume" :: held 1.209s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:13 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-1a63ecc9-6561-45ea-b1d4-b0810c658549 tempest-GroupSnapshotsTest-1740723573 None] Created reservations ['25c195d0-9952-4303-a4a4-c4bb60a4373f'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:13 devstack cinder-volume[81938]: WARNING cinder.quota [None req-1a63ecc9-6561-45ea-b1d4-b0810c658549 tempest-GroupSnapshotsTest-1740723573 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2130080916 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2130080916, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:35:13 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-1a63ecc9-6561-45ea-b1d4-b0810c658549 tempest-GroupSnapshotsTest-1740723573 None] Created reservations ['6ae0dddd-b35e-4be6-b551-944a6005642b', '0ab9a584-514d-4cb7-8a99-3e669c9dcb46', 'd58cea4a-5462-489a-90c9-875df17d0d6e', '26d713ab-cfa1-47cf-86db-c239b0c12b25'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1a63ecc9-6561-45ea-b1d4-b0810c658549 tempest-GroupSnapshotsTest-1740723573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1a63ecc9-6561-45ea-b1d4-b0810c658549 tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:13 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1a63ecc9-6561-45ea-b1d4-b0810c658549 tempest-GroupSnapshotsTest-1740723573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:13 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1a63ecc9-6561-45ea-b1d4-b0810c658549 tempest-GroupSnapshotsTest-1740723573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1a63ecc9-6561-45ea-b1d4-b0810c658549 tempest-GroupSnapshotsTest-1740723573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1a63ecc9-6561-45ea-b1d4-b0810c658549 tempest-GroupSnapshotsTest-1740723573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:13 devstack sudo[85455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:35:13 devstack sudo[85455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:13 devstack sudo[85453]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-61303216-2346-495f-a435-25a6c2b300d3 1073741824" returned: 0 in 0.565s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-61303216-2346-495f-a435-25a6c2b300d3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:13 devstack sudo[85460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-61303216-2346-495f-a435-25a6c2b300d3 Apr 10 10:35:13 devstack sudo[85460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:13 devstack sudo[85455]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1a63ecc9-6561-45ea-b1d4-b0810c658549 tempest-GroupSnapshotsTest-1740723573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.518s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:13 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-1a63ecc9-6561-45ea-b1d4-b0810c658549 tempest-GroupSnapshotsTest-1740723573 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:13 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-1a63ecc9-6561-45ea-b1d4-b0810c658549 tempest-GroupSnapshotsTest-1740723573 None] Delete group completed successfully. Apr 10 10:35:13 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:14 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] Flow 'volume_create_manager' (04a255ad-3c36-4dbd-9d79-b5fcf1c9868c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:14 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3910790-2d3c-4919-a06c-25748810721d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:14 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3910790-2d3c-4919-a06c-25748810721d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1162149013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e74e45c7-f2de-4acc-92e6-91e39bb29089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baea770816584a4084eca0081a8815c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:14Z,use_quota=True,user_id='d97b15b0e30d4d90a5b4d356b5dcf324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:14 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (979561d0-7872-42e7-ab1d-049a87095a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:14 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (979561d0-7872-42e7-ab1d-049a87095a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:14 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a6df4f-fa0b-435b-a705-b4d64a4c6fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:14 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a6df4f-fa0b-435b-a705-b4d64a4c6fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e74e45c7-f2de-4acc-92e6-91e39bb29089', 'volume_name': 'volume-e74e45c7-f2de-4acc-92e6-91e39bb29089', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:14 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bd09320-3520-4e0b-99d8-f418ff3ecec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:14 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bd09320-3520-4e0b-99d8-f418ff3ecec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:14 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (327f843f-eacf-4ce0-b15f-43c30bbfb30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:14 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] Volume e74e45c7-f2de-4acc-92e6-91e39bb29089: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e74e45c7-f2de-4acc-92e6-91e39bb29089', 'volume_size': 1} Apr 10 10:35:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:14 devstack sudo[85460]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-61303216-2346-495f-a435-25a6c2b300d3" returned: 0 in 0.539s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:14 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.158s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:14 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-155417899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64471c66-be81-42a3-89dc-f68d5a81351a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ddd2d918514949ff94b31c069e778d9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:13Z,use_quota=True,user_id='1b58326f0b8440faacfbf3c5be03f256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:14 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] Creating volume 64471c66-be81-42a3-89dc-f68d5a81351a {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:14 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:14 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:14 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:14 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:35:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-64471c66-be81-42a3-89dc-f68d5a81351a 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:14 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a689a795-f891-4279-966f-80359a88fce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61303216-2346-495f-a435-25a6c2b300d3', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:14 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d29e4845-1f4a-42c2-928e-3cd19e7a737d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:14 devstack sudo[85464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-64471c66-be81-42a3-89dc-f68d5a81351a 1073741824 Apr 10 10:35:14 devstack sudo[85464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:14 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Volume volume-61303216-2346-495f-a435-25a6c2b300d3 (61303216-2346-495f-a435-25a6c2b300d3): created successfully Apr 10 10:35:14 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d29e4845-1f4a-42c2-928e-3cd19e7a737d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:14 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Flow 'volume_create_manager' (fdd9e11d-1720-4944-ada5-879a58cbf710) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:14 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-a235bf6a-c58c-4675-aa22-ade4fc9c219f tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Created volume successfully. Apr 10 10:35:14 devstack sudo[85464]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-64471c66-be81-42a3-89dc-f68d5a81351a 1073741824" returned: 0 in 0.575s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-64471c66-be81-42a3-89dc-f68d5a81351a {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:14 devstack sudo[85469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-64471c66-be81-42a3-89dc-f68d5a81351a Apr 10 10:35:14 devstack sudo[85469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:15 devstack sudo[85469]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-64471c66-be81-42a3-89dc-f68d5a81351a" returned: 0 in 0.576s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:15 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.233s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:15 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1162149013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e74e45c7-f2de-4acc-92e6-91e39bb29089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baea770816584a4084eca0081a8815c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:14Z,use_quota=True,user_id='d97b15b0e30d4d90a5b4d356b5dcf324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:15 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] Creating volume e74e45c7-f2de-4acc-92e6-91e39bb29089 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:15 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:15 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:15 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:15 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:35:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e74e45c7-f2de-4acc-92e6-91e39bb29089 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:15 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58eaeac3-c58e-4267-a0eb-a99a153e6396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64471c66-be81-42a3-89dc-f68d5a81351a', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:15 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec1434b1-3484-42af-9211-3253fb430570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:15 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] Volume volume-64471c66-be81-42a3-89dc-f68d5a81351a (64471c66-be81-42a3-89dc-f68d5a81351a): created successfully Apr 10 10:35:15 devstack sudo[85472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e74e45c7-f2de-4acc-92e6-91e39bb29089 1073741824 Apr 10 10:35:15 devstack sudo[85472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:15 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec1434b1-3484-42af-9211-3253fb430570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:15 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] Flow 'volume_create_manager' (35c91978-4113-4172-b74f-7c2212705909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:15 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-70d7e0bf-fa45-42d2-bcad-f57aa0802733 tempest-VolumesTestJSON-209053586 None] Created volume successfully. Apr 10 10:35:15 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c4e2625c-280d-46ca-bb93-e48ed58c9f72 tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Acquiring lock "cinder-61303216-2346-495f-a435-25a6c2b300d3-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:15 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c4e2625c-280d-46ca-bb93-e48ed58c9f72 tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Lock "cinder-61303216-2346-495f-a435-25a6c2b300d3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:15 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c4e2625c-280d-46ca-bb93-e48ed58c9f72 tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Acquiring lock "cinder-quobyte-61303216-2346-495f-a435-25a6c2b300d3" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:15 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c4e2625c-280d-46ca-bb93-e48ed58c9f72 tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Lock "cinder-quobyte-61303216-2346-495f-a435-25a6c2b300d3" acquired by "delete_volume" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:15 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36648af-3444-4768-9bb3-f4582f17a6e2]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c4e2625c-280d-46ca-bb93-e48ed58c9f72 tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-61303216-2346-495f-a435-25a6c2b300d3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:15 devstack sudo[85474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-61303216-2346-495f-a435-25a6c2b300d3 Apr 10 10:35:15 devstack sudo[85474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:15 devstack sudo[85472]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e74e45c7-f2de-4acc-92e6-91e39bb29089 1073741824" returned: 0 in 0.687s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e74e45c7-f2de-4acc-92e6-91e39bb29089 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:16 devstack sudo[85480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e74e45c7-f2de-4acc-92e6-91e39bb29089 Apr 10 10:35:16 devstack sudo[85480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:16 devstack sudo[85474]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c4e2625c-280d-46ca-bb93-e48ed58c9f72 tempest-VolumeQuotasNegativeTestJSON-1441412855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-61303216-2346-495f-a435-25a6c2b300d3" returned: 0 in 0.638s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c4e2625c-280d-46ca-bb93-e48ed58c9f72 tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-61303216-2346-495f-a435-25a6c2b300d3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:16 devstack sudo[85484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-61303216-2346-495f-a435-25a6c2b300d3 Apr 10 10:35:16 devstack sudo[85484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:16 devstack sudo[85480]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e74e45c7-f2de-4acc-92e6-91e39bb29089" returned: 0 in 0.595s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:16 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:16 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (327f843f-eacf-4ce0-b15f-43c30bbfb30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e74e45c7-f2de-4acc-92e6-91e39bb29089', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:16 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab55add-2925-42f5-9c90-9d4f4af00ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:16 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] Volume volume-e74e45c7-f2de-4acc-92e6-91e39bb29089 (e74e45c7-f2de-4acc-92e6-91e39bb29089): created successfully Apr 10 10:35:16 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab55add-2925-42f5-9c90-9d4f4af00ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:16 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] Flow 'volume_create_manager' (04a255ad-3c36-4dbd-9d79-b5fcf1c9868c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:16 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-050c6d34-e110-4ecd-b7f8-c086b4891040 tempest-VolumesListAdminTestJSON-477560451 None] Created volume successfully. Apr 10 10:35:16 devstack sudo[85484]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c4e2625c-280d-46ca-bb93-e48ed58c9f72 tempest-VolumeQuotasNegativeTestJSON-1441412855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-61303216-2346-495f-a435-25a6c2b300d3" returned: 0 in 0.528s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:16 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c4e2625c-280d-46ca-bb93-e48ed58c9f72 tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Lock "cinder-quobyte-61303216-2346-495f-a435-25a6c2b300d3" released by "delete_volume" :: held 1.198s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:16 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-c4e2625c-280d-46ca-bb93-e48ed58c9f72 tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Created reservations ['cfc52572-c92c-49b6-9346-d15c153a4353', '361ca856-8bf9-4cee-8d78-33a1dabe8893', 'ccb66d17-a04c-4680-af3e-1eae7ba2000f', 'f0d1ef4b-4973-4769-a22f-95840e6a4ca6'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c4e2625c-280d-46ca-bb93-e48ed58c9f72 tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c4e2625c-280d-46ca-bb93-e48ed58c9f72 tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:16 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c4e2625c-280d-46ca-bb93-e48ed58c9f72 tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:16 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c4e2625c-280d-46ca-bb93-e48ed58c9f72 tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c4e2625c-280d-46ca-bb93-e48ed58c9f72 tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c4e2625c-280d-46ca-bb93-e48ed58c9f72 tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:16 devstack sudo[85488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:35:16 devstack sudo[85488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:16 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-25cb4919-25cf-46d3-b552-97fe0465e766 tempest-VolumesTestJSON-209053586 None] Acquiring lock "cinder-64471c66-be81-42a3-89dc-f68d5a81351a-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:16 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-25cb4919-25cf-46d3-b552-97fe0465e766 tempest-VolumesTestJSON-209053586 None] Lock "cinder-64471c66-be81-42a3-89dc-f68d5a81351a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:16 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-25cb4919-25cf-46d3-b552-97fe0465e766 tempest-VolumesTestJSON-209053586 None] Acquiring lock "cinder-quobyte-64471c66-be81-42a3-89dc-f68d5a81351a" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:17 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-25cb4919-25cf-46d3-b552-97fe0465e766 tempest-VolumesTestJSON-209053586 None] Lock "cinder-quobyte-64471c66-be81-42a3-89dc-f68d5a81351a" acquired by "delete_volume" :: waited 0.011s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:17 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[838a98f7-01b0-4674-a4f5-1490c6e24819]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-25cb4919-25cf-46d3-b552-97fe0465e766 tempest-VolumesTestJSON-209053586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-64471c66-be81-42a3-89dc-f68d5a81351a {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:17 devstack sudo[85490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-64471c66-be81-42a3-89dc-f68d5a81351a Apr 10 10:35:17 devstack sudo[85490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:17 devstack sudo[85488]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c4e2625c-280d-46ca-bb93-e48ed58c9f72 tempest-VolumeQuotasNegativeTestJSON-1441412855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.588s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:17 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-c4e2625c-280d-46ca-bb93-e48ed58c9f72 tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:17 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-c4e2625c-280d-46ca-bb93-e48ed58c9f72 tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Deleted volume successfully. Apr 10 10:35:17 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c4e2625c-280d-46ca-bb93-e48ed58c9f72 tempest-VolumeQuotasNegativeTestJSON-1441412855 None] Lock "cinder-61303216-2346-495f-a435-25a6c2b300d3-delete_volume" released by "delete_volume" :: held 1.993s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:17 devstack sudo[85490]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-25cb4919-25cf-46d3-b552-97fe0465e766 tempest-VolumesTestJSON-209053586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-64471c66-be81-42a3-89dc-f68d5a81351a" returned: 0 in 0.709s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-25cb4919-25cf-46d3-b552-97fe0465e766 tempest-VolumesTestJSON-209053586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-64471c66-be81-42a3-89dc-f68d5a81351a {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:17 devstack sudo[85496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-64471c66-be81-42a3-89dc-f68d5a81351a Apr 10 10:35:17 devstack sudo[85496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:17 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:17 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] Flow 'volume_create_manager' (7b054143-4901-4c25-8de9-04b608e15737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:17 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4cdb3fd-8f05-4b46-ba2b-30bd817b7405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:17 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4cdb3fd-8f05-4b46-ba2b-30bd817b7405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18a651fd-ccbd-4ffc-b133-74b99379a0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d2b342a1c544f1993c583e072ae0c59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:18Z,use_quota=True,user_id='e8b6f40f261f404eb397293c8161b708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:17 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (467e323e-861d-4abf-93e8-276899bc8296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:17 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (467e323e-861d-4abf-93e8-276899bc8296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:17 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c3e739e-3763-4f89-858b-5e7d8f58cb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:17 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c3e739e-3763-4f89-858b-5e7d8f58cb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18a651fd-ccbd-4ffc-b133-74b99379a0bb', 'volume_name': 'volume-18a651fd-ccbd-4ffc-b133-74b99379a0bb', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:17 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (957fc4bb-6bc5-4ad8-a3f1-18cca0fc2f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:17 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (957fc4bb-6bc5-4ad8-a3f1-18cca0fc2f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:17 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5fb6e76-7de4-4be8-82db-03ae0d21e313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:17 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] Volume 18a651fd-ccbd-4ffc-b133-74b99379a0bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18a651fd-ccbd-4ffc-b133-74b99379a0bb', 'volume_size': 1} Apr 10 10:35:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:17 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18a651fd-ccbd-4ffc-b133-74b99379a0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d2b342a1c544f1993c583e072ae0c59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:18Z,use_quota=True,user_id='e8b6f40f261f404eb397293c8161b708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:17 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] Creating volume 18a651fd-ccbd-4ffc-b133-74b99379a0bb {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:17 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:17 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:17 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:17 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:35:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-18a651fd-ccbd-4ffc-b133-74b99379a0bb 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:17 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-2b8555e8-b1d8-4d81-b893-961ab5c66837 tempest-GroupsV314Test-346698735 None] Group tempest-GroupsV314Test-Group-1376184030: creating Apr 10 10:35:17 devstack sudo[85498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-18a651fd-ccbd-4ffc-b133-74b99379a0bb 1073741824 Apr 10 10:35:17 devstack sudo[85498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:17 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-2b8555e8-b1d8-4d81-b893-961ab5c66837 tempest-GroupsV314Test-346698735 None] Group tempest-GroupsV314Test-Group-1376184030: created successfully Apr 10 10:35:17 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-2b8555e8-b1d8-4d81-b893-961ab5c66837 tempest-GroupsV314Test-346698735 None] Create group completed successfully. Apr 10 10:35:18 devstack sudo[85496]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-25cb4919-25cf-46d3-b552-97fe0465e766 tempest-VolumesTestJSON-209053586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-64471c66-be81-42a3-89dc-f68d5a81351a" returned: 0 in 0.494s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:18 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-25cb4919-25cf-46d3-b552-97fe0465e766 tempest-VolumesTestJSON-209053586 None] Lock "cinder-quobyte-64471c66-be81-42a3-89dc-f68d5a81351a" released by "delete_volume" :: held 1.228s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:18 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-25cb4919-25cf-46d3-b552-97fe0465e766 tempest-VolumesTestJSON-209053586 None] Created reservations ['0412588c-28ed-4ccb-887d-fada2a0e0d46', 'c431dca0-f97d-46d4-96fd-88c1e38e5896', 'c83fc2bc-975b-4a0f-b0de-cfa327c03e4d', '6aa6013d-f8a8-4795-a181-80aed97fe999'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-25cb4919-25cf-46d3-b552-97fe0465e766 tempest-VolumesTestJSON-209053586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-25cb4919-25cf-46d3-b552-97fe0465e766 tempest-VolumesTestJSON-209053586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:18 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-25cb4919-25cf-46d3-b552-97fe0465e766 tempest-VolumesTestJSON-209053586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:18 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-25cb4919-25cf-46d3-b552-97fe0465e766 tempest-VolumesTestJSON-209053586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-25cb4919-25cf-46d3-b552-97fe0465e766 tempest-VolumesTestJSON-209053586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-25cb4919-25cf-46d3-b552-97fe0465e766 tempest-VolumesTestJSON-209053586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:18 devstack sudo[85501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:35:18 devstack sudo[85501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:18 devstack sudo[85498]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-18a651fd-ccbd-4ffc-b133-74b99379a0bb 1073741824" returned: 0 in 0.705s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-18a651fd-ccbd-4ffc-b133-74b99379a0bb {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:18 devstack sudo[85506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-18a651fd-ccbd-4ffc-b133-74b99379a0bb Apr 10 10:35:18 devstack sudo[85506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:18 devstack sudo[85501]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-25cb4919-25cf-46d3-b552-97fe0465e766 tempest-VolumesTestJSON-209053586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.497s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:18 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-25cb4919-25cf-46d3-b552-97fe0465e766 tempest-VolumesTestJSON-209053586 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:18 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-25cb4919-25cf-46d3-b552-97fe0465e766 tempest-VolumesTestJSON-209053586 None] Deleted volume successfully. Apr 10 10:35:18 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-25cb4919-25cf-46d3-b552-97fe0465e766 tempest-VolumesTestJSON-209053586 None] Lock "cinder-64471c66-be81-42a3-89dc-f68d5a81351a-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-df923a37-1536-4a98-ade8-45c3c8d06f7e tempest-VolumesTestJSON-209053586 None] Acquiring lock "cinder-b73e9a9a-033d-43a7-8cb1-915779805083-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-df923a37-1536-4a98-ade8-45c3c8d06f7e tempest-VolumesTestJSON-209053586 None] Lock "cinder-b73e9a9a-033d-43a7-8cb1-915779805083-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:19 devstack sudo[85506]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-df923a37-1536-4a98-ade8-45c3c8d06f7e tempest-VolumesTestJSON-209053586 None] Acquiring lock "cinder-quobyte-b73e9a9a-033d-43a7-8cb1-915779805083" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-18a651fd-ccbd-4ffc-b133-74b99379a0bb" returned: 0 in 0.615s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5fb6e76-7de4-4be8-82db-03ae0d21e313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18a651fd-ccbd-4ffc-b133-74b99379a0bb', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6c7252-cef2-4cba-b123-3e7c2a748a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-df923a37-1536-4a98-ade8-45c3c8d06f7e tempest-VolumesTestJSON-209053586 None] Lock "cinder-quobyte-b73e9a9a-033d-43a7-8cb1-915779805083" acquired by "delete_volume" :: waited 0.037s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:19 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] Volume volume-18a651fd-ccbd-4ffc-b133-74b99379a0bb (18a651fd-ccbd-4ffc-b133-74b99379a0bb): created successfully Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6c7252-cef2-4cba-b123-3e7c2a748a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] Flow 'volume_create_manager' (7b054143-4901-4c25-8de9-04b608e15737) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec8e7bc-ec6f-431f-b8e5-66b9fdb4ffb1]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-df923a37-1536-4a98-ade8-45c3c8d06f7e tempest-VolumesTestJSON-209053586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b73e9a9a-033d-43a7-8cb1-915779805083 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] Flow 'volume_create_manager' (83cf58f1-0a34-40d7-b7e6-9cda7d1837b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b467c95-6998-432a-9e4e-66db6a94de06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:19 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-b781305b-8e59-4dec-9616-5c1ad66a0d80 tempest-VolumesListAdminTestJSON-2087761860 None] Created volume successfully. Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b467c95-6998-432a-9e4e-66db6a94de06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1588176863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=371f6acf-1841-402d-8a97-692e1dabfae9,host='devstack@QuobyteHD#QuobyteHD',id=968f74b0-b192-4796-8ee8-32dca54f860e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b700e1ee8824423bf850244bf6639ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:19Z,use_quota=True,user_id='95d557cc316d4ac4bba5521c52463c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5546e0bc-dedb-456d-863e-094d5d880747),volume_type_id=5546e0bc-dedb-456d-863e-094d5d880747)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b147c38-02c5-4e72-a2ed-4a0ca3839786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b147c38-02c5-4e72-a2ed-4a0ca3839786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (435c9d62-4e15-4c2e-ac99-20507b85cff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (435c9d62-4e15-4c2e-ac99-20507b85cff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '968f74b0-b192-4796-8ee8-32dca54f860e', 'volume_name': 'volume-968f74b0-b192-4796-8ee8-32dca54f860e', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee34f87b-e93c-4bcc-98e6-0f2b6d8201cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee34f87b-e93c-4bcc-98e6-0f2b6d8201cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:19 devstack sudo[85510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b73e9a9a-033d-43a7-8cb1-915779805083 Apr 10 10:35:19 devstack sudo[85510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f116ba7-730b-4394-b153-04552f17bba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:19 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] Volume 968f74b0-b192-4796-8ee8-32dca54f860e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-968f74b0-b192-4796-8ee8-32dca54f860e', 'volume_size': 1} Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=371f6acf-1841-402d-8a97-692e1dabfae9,created_at=2026-04-10T08:35:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1588176863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=371f6acf-1841-402d-8a97-692e1dabfae9,host='devstack@QuobyteHD#QuobyteHD',id=968f74b0-b192-4796-8ee8-32dca54f860e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b700e1ee8824423bf850244bf6639ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:19Z,use_quota=True,user_id='95d557cc316d4ac4bba5521c52463c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5546e0bc-dedb-456d-863e-094d5d880747),volume_type_id=5546e0bc-dedb-456d-863e-094d5d880747)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] Creating volume 968f74b0-b192-4796-8ee8-32dca54f860e {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:19 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:19 devstack sudo[85512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e 1073741824 Apr 10 10:35:19 devstack sudo[85512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:19 devstack sudo[85510]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-df923a37-1536-4a98-ade8-45c3c8d06f7e tempest-VolumesTestJSON-209053586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b73e9a9a-033d-43a7-8cb1-915779805083" returned: 0 in 0.689s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-df923a37-1536-4a98-ade8-45c3c8d06f7e tempest-VolumesTestJSON-209053586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b73e9a9a-033d-43a7-8cb1-915779805083 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:20 devstack sudo[85521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b73e9a9a-033d-43a7-8cb1-915779805083 Apr 10 10:35:20 devstack sudo[85521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:20 devstack sudo[85512]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e 1073741824" returned: 0 in 0.624s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-734b5ddf-a9e7-407e-bee5-2378d9bfb044 tempest-VolumesListAdminTestJSON-2087761860 None] Acquiring lock "cinder-18a651fd-ccbd-4ffc-b133-74b99379a0bb-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-734b5ddf-a9e7-407e-bee5-2378d9bfb044 tempest-VolumesListAdminTestJSON-2087761860 None] Lock "cinder-18a651fd-ccbd-4ffc-b133-74b99379a0bb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:20 devstack sudo[85523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e Apr 10 10:35:20 devstack sudo[85523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-734b5ddf-a9e7-407e-bee5-2378d9bfb044 tempest-VolumesListAdminTestJSON-2087761860 None] Acquiring lock "cinder-quobyte-18a651fd-ccbd-4ffc-b133-74b99379a0bb" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-734b5ddf-a9e7-407e-bee5-2378d9bfb044 tempest-VolumesListAdminTestJSON-2087761860 None] Lock "cinder-quobyte-18a651fd-ccbd-4ffc-b133-74b99379a0bb" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd2814e-c59c-43b9-94e6-587391e04cb9]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-734b5ddf-a9e7-407e-bee5-2378d9bfb044 tempest-VolumesListAdminTestJSON-2087761860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-18a651fd-ccbd-4ffc-b133-74b99379a0bb {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f6ca149f-c994-4a67-bd08-78c62399dee5 tempest-VolumesListAdminTestJSON-477560451 None] Acquiring lock "cinder-e74e45c7-f2de-4acc-92e6-91e39bb29089-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f6ca149f-c994-4a67-bd08-78c62399dee5 tempest-VolumesListAdminTestJSON-477560451 None] Lock "cinder-e74e45c7-f2de-4acc-92e6-91e39bb29089-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f6ca149f-c994-4a67-bd08-78c62399dee5 tempest-VolumesListAdminTestJSON-477560451 None] Acquiring lock "cinder-quobyte-e74e45c7-f2de-4acc-92e6-91e39bb29089" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f6ca149f-c994-4a67-bd08-78c62399dee5 tempest-VolumesListAdminTestJSON-477560451 None] Lock "cinder-quobyte-e74e45c7-f2de-4acc-92e6-91e39bb29089" acquired by "delete_volume" :: waited 0.011s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[771258ae-1c3a-460b-abba-4fa478ffe43b]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f6ca149f-c994-4a67-bd08-78c62399dee5 tempest-VolumesListAdminTestJSON-477560451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e74e45c7-f2de-4acc-92e6-91e39bb29089 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:20 devstack sudo[85525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-18a651fd-ccbd-4ffc-b133-74b99379a0bb Apr 10 10:35:20 devstack sudo[85525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:20 devstack sudo[85526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e74e45c7-f2de-4acc-92e6-91e39bb29089 Apr 10 10:35:20 devstack sudo[85526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:20 devstack sudo[85523]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e" returned: 0 in 0.578s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f116ba7-730b-4394-b153-04552f17bba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-968f74b0-b192-4796-8ee8-32dca54f860e', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:20 devstack sudo[85521]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78f0393e-57cd-4b39-9d01-646ea1317b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-df923a37-1536-4a98-ade8-45c3c8d06f7e tempest-VolumesTestJSON-209053586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b73e9a9a-033d-43a7-8cb1-915779805083" returned: 0 in 0.687s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-df923a37-1536-4a98-ade8-45c3c8d06f7e tempest-VolumesTestJSON-209053586 None] Lock "cinder-quobyte-b73e9a9a-033d-43a7-8cb1-915779805083" released by "delete_volume" :: held 1.437s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:20 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] Volume volume-968f74b0-b192-4796-8ee8-32dca54f860e (968f74b0-b192-4796-8ee8-32dca54f860e): created successfully Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78f0393e-57cd-4b39-9d01-646ea1317b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] Flow 'volume_create_manager' (83cf58f1-0a34-40d7-b7e6-9cda7d1837b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:20 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-6d220ca5-ea98-43f8-9667-b77c8ff39233 tempest-GroupsV314Test-346698735 None] Created volume successfully. Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-df923a37-1536-4a98-ade8-45c3c8d06f7e tempest-VolumesTestJSON-209053586 None] Created reservations ['be085d03-2405-47ea-8889-89ba9cc21c94', '13f9d8f1-9990-4002-9af7-71a3097fe099', '7840e645-6e98-4a21-a5ff-b9facfc8643c', 'f1fa1b52-33c0-4044-a503-19a82cb61123'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-df923a37-1536-4a98-ade8-45c3c8d06f7e tempest-VolumesTestJSON-209053586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-df923a37-1536-4a98-ade8-45c3c8d06f7e tempest-VolumesTestJSON-209053586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-df923a37-1536-4a98-ade8-45c3c8d06f7e tempest-VolumesTestJSON-209053586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-df923a37-1536-4a98-ade8-45c3c8d06f7e tempest-VolumesTestJSON-209053586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-df923a37-1536-4a98-ade8-45c3c8d06f7e tempest-VolumesTestJSON-209053586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-df923a37-1536-4a98-ade8-45c3c8d06f7e tempest-VolumesTestJSON-209053586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:20 devstack sudo[85534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:35:20 devstack sudo[85534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:20 devstack sudo[85525]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-734b5ddf-a9e7-407e-bee5-2378d9bfb044 tempest-VolumesListAdminTestJSON-2087761860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-18a651fd-ccbd-4ffc-b133-74b99379a0bb" returned: 0 in 0.744s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-734b5ddf-a9e7-407e-bee5-2378d9bfb044 tempest-VolumesListAdminTestJSON-2087761860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-18a651fd-ccbd-4ffc-b133-74b99379a0bb {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:20 devstack sudo[85539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-18a651fd-ccbd-4ffc-b133-74b99379a0bb Apr 10 10:35:20 devstack sudo[85539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:21 devstack sudo[85526]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f6ca149f-c994-4a67-bd08-78c62399dee5 tempest-VolumesListAdminTestJSON-477560451 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e74e45c7-f2de-4acc-92e6-91e39bb29089" returned: 0 in 0.739s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f6ca149f-c994-4a67-bd08-78c62399dee5 tempest-VolumesListAdminTestJSON-477560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e74e45c7-f2de-4acc-92e6-91e39bb29089 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:21 devstack sudo[85541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e74e45c7-f2de-4acc-92e6-91e39bb29089 Apr 10 10:35:21 devstack sudo[85541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:21 devstack sudo[85534]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-df923a37-1536-4a98-ade8-45c3c8d06f7e tempest-VolumesTestJSON-209053586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.581s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:21 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-df923a37-1536-4a98-ade8-45c3c8d06f7e tempest-VolumesTestJSON-209053586 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:21 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-df923a37-1536-4a98-ade8-45c3c8d06f7e tempest-VolumesTestJSON-209053586 None] Deleted volume successfully. Apr 10 10:35:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-4db8ee39-415e-427e-a909-fedb9e1bdd3e tempest-VolumesTestJSON-209053586 None] Acquiring lock "cinder-e9d40175-938a-4af5-a280-517d27823570-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-df923a37-1536-4a98-ade8-45c3c8d06f7e tempest-VolumesTestJSON-209053586 None] Lock "cinder-b73e9a9a-033d-43a7-8cb1-915779805083-delete_volume" released by "delete_volume" :: held 2.261s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-4db8ee39-415e-427e-a909-fedb9e1bdd3e tempest-VolumesTestJSON-209053586 None] Lock "cinder-e9d40175-938a-4af5-a280-517d27823570-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:21 devstack sudo[85539]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-734b5ddf-a9e7-407e-bee5-2378d9bfb044 tempest-VolumesListAdminTestJSON-2087761860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-18a651fd-ccbd-4ffc-b133-74b99379a0bb" returned: 0 in 0.582s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-4db8ee39-415e-427e-a909-fedb9e1bdd3e tempest-VolumesTestJSON-209053586 None] Acquiring lock "cinder-quobyte-e9d40175-938a-4af5-a280-517d27823570" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-734b5ddf-a9e7-407e-bee5-2378d9bfb044 tempest-VolumesListAdminTestJSON-2087761860 None] Lock "cinder-quobyte-18a651fd-ccbd-4ffc-b133-74b99379a0bb" released by "delete_volume" :: held 1.370s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-4db8ee39-415e-427e-a909-fedb9e1bdd3e tempest-VolumesTestJSON-209053586 None] Lock "cinder-quobyte-e9d40175-938a-4af5-a280-517d27823570" acquired by "delete_volume" :: waited 0.015s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:21 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9db6d6-b97d-4ef8-b382-4840ee54416e]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4db8ee39-415e-427e-a909-fedb9e1bdd3e tempest-VolumesTestJSON-209053586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e9d40175-938a-4af5-a280-517d27823570 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:21 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-734b5ddf-a9e7-407e-bee5-2378d9bfb044 tempest-VolumesListAdminTestJSON-2087761860 None] Created reservations ['e832bb20-9c00-4124-95c6-a4adc613a27d', '3cb88f46-3be8-4dca-88ab-18f895b7e95f', 'f619c499-7a13-4aea-9905-d32caa0adebf', 'a076704b-9667-4fd4-8dc5-ad993234b16c'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:21 devstack sudo[85546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e9d40175-938a-4af5-a280-517d27823570 Apr 10 10:35:21 devstack sudo[85546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:21 devstack cinder-volume[81938]: DEBUG oslo_db.api [None req-734b5ddf-a9e7-407e-bee5-2378d9bfb044 tempest-VolumesListAdminTestJSON-2087761860 None] DB error: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Apr 10 10:35:21 devstack cinder-volume[81938]: [SQL: SELECT reservations.id AS reservations_id, reservations.uuid AS reservations_uuid, reservations.usage_id AS reservations_usage_id, reservations.project_id AS reservations_project_id, reservations.resource AS reservations_resource, reservations.delta AS reservations_delta, reservations.expire AS reservations_expire, reservations.deleted_at AS reservations_deleted_at, reservations.deleted AS reservations_deleted, reservations.created_at AS reservations_created_at, reservations.updated_at AS reservations_updated_at Apr 10 10:35:21 devstack cinder-volume[81938]: FROM reservations Apr 10 10:35:21 devstack cinder-volume[81938]: WHERE reservations.deleted = false AND reservations.uuid IN (%(uuid_1_1)s, %(uuid_1_2)s, %(uuid_1_3)s, %(uuid_1_4)s) FOR UPDATE] Apr 10 10:35:21 devstack cinder-volume[81938]: [parameters: {'uuid_1_1': 'e832bb20-9c00-4124-95c6-a4adc613a27d', 'uuid_1_2': '3cb88f46-3be8-4dca-88ab-18f895b7e95f', 'uuid_1_3': 'f619c499-7a13-4aea-9905-d32caa0adebf', 'uuid_1_4': 'a076704b-9667-4fd4-8dc5-ad993234b16c'}] Apr 10 10:35:21 devstack cinder-volume[81938]: (Background on this error at: https://sqlalche.me/e/20/e3q8) {{(pid=81938) _is_exception_expected /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/api.py:184}} Apr 10 10:35:21 devstack cinder-volume[81938]: DEBUG oslo_db.api [None req-734b5ddf-a9e7-407e-bee5-2378d9bfb044 tempest-VolumesListAdminTestJSON-2087761860 None] Performing DB retry for function cinder.db.sqlalchemy.api.reservation_commit {{(pid=81938) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/api.py:155}} Apr 10 10:35:21 devstack sudo[85541]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f6ca149f-c994-4a67-bd08-78c62399dee5 tempest-VolumesListAdminTestJSON-477560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e74e45c7-f2de-4acc-92e6-91e39bb29089" returned: 0 in 0.630s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f6ca149f-c994-4a67-bd08-78c62399dee5 tempest-VolumesListAdminTestJSON-477560451 None] Lock "cinder-quobyte-e74e45c7-f2de-4acc-92e6-91e39bb29089" released by "delete_volume" :: held 1.395s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:21 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-f6ca149f-c994-4a67-bd08-78c62399dee5 tempest-VolumesListAdminTestJSON-477560451 None] Created reservations ['6c22c707-89b6-40ef-a23b-eb1e251bebea', '14d8a62f-3d0f-4b65-8d90-38ac5168a37b', 'a1d16884-7436-4791-a620-c3b533b92004', '193384ca-71c7-4c6a-8235-17215736b8e1'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f6ca149f-c994-4a67-bd08-78c62399dee5 tempest-VolumesListAdminTestJSON-477560451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f6ca149f-c994-4a67-bd08-78c62399dee5 tempest-VolumesListAdminTestJSON-477560451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:21 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f6ca149f-c994-4a67-bd08-78c62399dee5 tempest-VolumesListAdminTestJSON-477560451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:21 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f6ca149f-c994-4a67-bd08-78c62399dee5 tempest-VolumesListAdminTestJSON-477560451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f6ca149f-c994-4a67-bd08-78c62399dee5 tempest-VolumesListAdminTestJSON-477560451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f6ca149f-c994-4a67-bd08-78c62399dee5 tempest-VolumesListAdminTestJSON-477560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:21 devstack sudo[85548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:35:21 devstack sudo[85548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:22 devstack sudo[85546]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4db8ee39-415e-427e-a909-fedb9e1bdd3e tempest-VolumesTestJSON-209053586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e9d40175-938a-4af5-a280-517d27823570" returned: 0 in 0.576s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4db8ee39-415e-427e-a909-fedb9e1bdd3e tempest-VolumesTestJSON-209053586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e9d40175-938a-4af5-a280-517d27823570 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:22 devstack sudo[85553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e9d40175-938a-4af5-a280-517d27823570 Apr 10 10:35:22 devstack sudo[85553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:22 devstack sudo[85548]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f6ca149f-c994-4a67-bd08-78c62399dee5 tempest-VolumesListAdminTestJSON-477560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.499s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-f6ca149f-c994-4a67-bd08-78c62399dee5 tempest-VolumesListAdminTestJSON-477560451 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:22 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-f6ca149f-c994-4a67-bd08-78c62399dee5 tempest-VolumesListAdminTestJSON-477560451 None] Deleted volume successfully. Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f6ca149f-c994-4a67-bd08-78c62399dee5 tempest-VolumesListAdminTestJSON-477560451 None] Lock "cinder-e74e45c7-f2de-4acc-92e6-91e39bb29089-delete_volume" released by "delete_volume" :: held 2.066s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:22 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Cloning volume 968f74b0-b192-4796-8ee8-32dca54f860e to volume 584fd2e3-f8ac-4a6e-aa98-0f22c8d9f69d Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Creating offline snapshot 7e7cc7dd-de04-4c62-8fae-0b19193e0cf3 of volume 968f74b0-b192-4796-8ee8-32dca54f860e {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[430dc8ea-a291-4cb4-8b71-86e476b6a23d]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:22 devstack sudo[85556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e Apr 10 10:35:22 devstack sudo[85556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c6dcb492-424d-4e7a-8524-f0a02d6e367b tempest-VolumesListAdminTestJSON-477560451 None] Acquiring lock "cinder-7c9cc1c3-68ce-4acd-b806-1eb7581dd07a-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c6dcb492-424d-4e7a-8524-f0a02d6e367b tempest-VolumesListAdminTestJSON-477560451 None] Lock "cinder-7c9cc1c3-68ce-4acd-b806-1eb7581dd07a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c6dcb492-424d-4e7a-8524-f0a02d6e367b tempest-VolumesListAdminTestJSON-477560451 None] Acquiring lock "cinder-quobyte-7c9cc1c3-68ce-4acd-b806-1eb7581dd07a" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:22 devstack sudo[85553]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4db8ee39-415e-427e-a909-fedb9e1bdd3e tempest-VolumesTestJSON-209053586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e9d40175-938a-4af5-a280-517d27823570" returned: 0 in 0.536s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c6dcb492-424d-4e7a-8524-f0a02d6e367b tempest-VolumesListAdminTestJSON-477560451 None] Lock "cinder-quobyte-7c9cc1c3-68ce-4acd-b806-1eb7581dd07a" acquired by "delete_volume" :: waited 0.017s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[614ca174-efba-46c2-b42c-7205784d16ff]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c6dcb492-424d-4e7a-8524-f0a02d6e367b tempest-VolumesListAdminTestJSON-477560451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7c9cc1c3-68ce-4acd-b806-1eb7581dd07a {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-4db8ee39-415e-427e-a909-fedb9e1bdd3e tempest-VolumesTestJSON-209053586 None] Lock "cinder-quobyte-e9d40175-938a-4af5-a280-517d27823570" released by "delete_volume" :: held 1.181s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-734b5ddf-a9e7-407e-bee5-2378d9bfb044 tempest-VolumesListAdminTestJSON-2087761860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-734b5ddf-a9e7-407e-bee5-2378d9bfb044 tempest-VolumesListAdminTestJSON-2087761860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-734b5ddf-a9e7-407e-bee5-2378d9bfb044 tempest-VolumesListAdminTestJSON-2087761860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-734b5ddf-a9e7-407e-bee5-2378d9bfb044 tempest-VolumesListAdminTestJSON-2087761860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-734b5ddf-a9e7-407e-bee5-2378d9bfb044 tempest-VolumesListAdminTestJSON-2087761860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-734b5ddf-a9e7-407e-bee5-2378d9bfb044 tempest-VolumesListAdminTestJSON-2087761860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:22 devstack sudo[85560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:35:22 devstack sudo[85560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-4db8ee39-415e-427e-a909-fedb9e1bdd3e tempest-VolumesTestJSON-209053586 None] Created reservations ['94d7bfa1-ce54-4af7-9001-77f14a1f351e', '21566349-99c8-4d43-88b1-3c4ae1ec6ed7', 'f6276e95-3a1c-42f6-810d-19e7a741e830', 'b9c549af-58ec-4389-8968-5ce27499da98'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:22 devstack sudo[85559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7c9cc1c3-68ce-4acd-b806-1eb7581dd07a Apr 10 10:35:22 devstack sudo[85559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-4db8ee39-415e-427e-a909-fedb9e1bdd3e tempest-VolumesTestJSON-209053586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-4db8ee39-415e-427e-a909-fedb9e1bdd3e tempest-VolumesTestJSON-209053586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-4db8ee39-415e-427e-a909-fedb9e1bdd3e tempest-VolumesTestJSON-209053586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-4db8ee39-415e-427e-a909-fedb9e1bdd3e tempest-VolumesTestJSON-209053586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-4db8ee39-415e-427e-a909-fedb9e1bdd3e tempest-VolumesTestJSON-209053586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4db8ee39-415e-427e-a909-fedb9e1bdd3e tempest-VolumesTestJSON-209053586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:22 devstack sudo[85563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:35:22 devstack sudo[85563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] Flow 'volume_create_manager' (aaa16d4f-ae99-4daf-a2d6-72568ebb5360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f82d445-e62d-4f1f-8d78-a51dc8661e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f82d445-e62d-4f1f-8d78-a51dc8661e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1046306588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77afffa6-b034-44a8-b915-b59fede42c2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdc2bb62cc5c4341b9529571f0e9368f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:23Z,use_quota=True,user_id='10714356e73841b5a80acc068652dd05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d260b96f-9b8a-446c-94a5-a68e4994c26e),volume_type_id=d260b96f-9b8a-446c-94a5-a68e4994c26e)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87bacfdf-2d11-4fff-ad5d-522f63b600fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87bacfdf-2d11-4fff-ad5d-522f63b600fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1339fd-c94a-4b80-a1ed-b5ce3fc7a8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1339fd-c94a-4b80-a1ed-b5ce3fc7a8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77afffa6-b034-44a8-b915-b59fede42c2f', 'volume_name': 'volume-77afffa6-b034-44a8-b915-b59fede42c2f', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c54075de-5d48-4e10-a626-94e39491fd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c54075de-5d48-4e10-a626-94e39491fd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf79809-9e23-4676-8551-513ae75f919d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:22 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] Volume 77afffa6-b034-44a8-b915-b59fede42c2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77afffa6-b034-44a8-b915-b59fede42c2f', 'volume_size': 1} Apr 10 10:35:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:23 devstack sudo[85556]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e" returned: 0 in 0.729s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e.7e7cc7dd-de04-4c62-8fae-0b19193e0cf3 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:23 devstack sudo[85569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e.7e7cc7dd-de04-4c62-8fae-0b19193e0cf3 1G Apr 10 10:35:23 devstack sudo[85569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:23 devstack sudo[85560]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-734b5ddf-a9e7-407e-bee5-2378d9bfb044 tempest-VolumesListAdminTestJSON-2087761860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.541s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:23 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-734b5ddf-a9e7-407e-bee5-2378d9bfb044 tempest-VolumesListAdminTestJSON-2087761860 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:23 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-734b5ddf-a9e7-407e-bee5-2378d9bfb044 tempest-VolumesListAdminTestJSON-2087761860 None] Deleted volume successfully. Apr 10 10:35:23 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-734b5ddf-a9e7-407e-bee5-2378d9bfb044 tempest-VolumesListAdminTestJSON-2087761860 None] Lock "cinder-18a651fd-ccbd-4ffc-b133-74b99379a0bb-delete_volume" released by "delete_volume" :: held 3.239s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:23 devstack sudo[85563]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4db8ee39-415e-427e-a909-fedb9e1bdd3e tempest-VolumesTestJSON-209053586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.524s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:23 devstack sudo[85559]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:23 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-4db8ee39-415e-427e-a909-fedb9e1bdd3e tempest-VolumesTestJSON-209053586 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c6dcb492-424d-4e7a-8524-f0a02d6e367b tempest-VolumesListAdminTestJSON-477560451 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7c9cc1c3-68ce-4acd-b806-1eb7581dd07a" returned: 0 in 0.703s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c6dcb492-424d-4e7a-8524-f0a02d6e367b tempest-VolumesListAdminTestJSON-477560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7c9cc1c3-68ce-4acd-b806-1eb7581dd07a {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:23 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-4db8ee39-415e-427e-a909-fedb9e1bdd3e tempest-VolumesTestJSON-209053586 None] Deleted volume successfully. Apr 10 10:35:23 devstack sudo[85575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7c9cc1c3-68ce-4acd-b806-1eb7581dd07a Apr 10 10:35:23 devstack sudo[85575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:23 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-4db8ee39-415e-427e-a909-fedb9e1bdd3e tempest-VolumesTestJSON-209053586 None] Lock "cinder-e9d40175-938a-4af5-a280-517d27823570-delete_volume" released by "delete_volume" :: held 1.957s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:23 devstack sudo[85569]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e.7e7cc7dd-de04-4c62-8fae-0b19193e0cf3 1G" returned: 0 in 0.558s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-968f74b0-b192-4796-8ee8-32dca54f860e -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e.7e7cc7dd-de04-4c62-8fae-0b19193e0cf3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:23 devstack sudo[85580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-968f74b0-b192-4796-8ee8-32dca54f860e -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e.7e7cc7dd-de04-4c62-8fae-0b19193e0cf3 Apr 10 10:35:23 devstack sudo[85580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:23 devstack sudo[85575]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c6dcb492-424d-4e7a-8524-f0a02d6e367b tempest-VolumesListAdminTestJSON-477560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7c9cc1c3-68ce-4acd-b806-1eb7581dd07a" returned: 0 in 0.505s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:23 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c6dcb492-424d-4e7a-8524-f0a02d6e367b tempest-VolumesListAdminTestJSON-477560451 None] Lock "cinder-quobyte-7c9cc1c3-68ce-4acd-b806-1eb7581dd07a" released by "delete_volume" :: held 1.241s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:23 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-c6dcb492-424d-4e7a-8524-f0a02d6e367b tempest-VolumesListAdminTestJSON-477560451 None] Created reservations ['1011947d-ab27-4857-915a-ed9b8baee5d0', 'a846dea0-acae-450c-b1df-4847ae22eb03', 'c1902bea-b994-48c4-8834-36ddaf4dec7a', '3c3d155d-ec4c-428d-9180-7da0f6bf2c96'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c6dcb492-424d-4e7a-8524-f0a02d6e367b tempest-VolumesListAdminTestJSON-477560451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c6dcb492-424d-4e7a-8524-f0a02d6e367b tempest-VolumesListAdminTestJSON-477560451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:23 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c6dcb492-424d-4e7a-8524-f0a02d6e367b tempest-VolumesListAdminTestJSON-477560451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:23 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c6dcb492-424d-4e7a-8524-f0a02d6e367b tempest-VolumesListAdminTestJSON-477560451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c6dcb492-424d-4e7a-8524-f0a02d6e367b tempest-VolumesListAdminTestJSON-477560451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c6dcb492-424d-4e7a-8524-f0a02d6e367b tempest-VolumesListAdminTestJSON-477560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:24 devstack sudo[85583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:35:24 devstack sudo[85583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:24 devstack sudo[85580]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-968f74b0-b192-4796-8ee8-32dca54f860e -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e.7e7cc7dd-de04-4c62-8fae-0b19193e0cf3" returned: 0 in 0.544s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:24 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e.7e7cc7dd-de04-4c62-8fae-0b19193e0cf3 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:35:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e.7e7cc7dd-de04-4c62-8fae-0b19193e0cf3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:24 devstack sudo[85588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e.7e7cc7dd-de04-4c62-8fae-0b19193e0cf3 Apr 10 10:35:24 devstack sudo[85588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:24 devstack sudo[85583]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c6dcb492-424d-4e7a-8524-f0a02d6e367b tempest-VolumesListAdminTestJSON-477560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.511s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:24 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-c6dcb492-424d-4e7a-8524-f0a02d6e367b tempest-VolumesListAdminTestJSON-477560451 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:24 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-c6dcb492-424d-4e7a-8524-f0a02d6e367b tempest-VolumesListAdminTestJSON-477560451 None] Deleted volume successfully. Apr 10 10:35:24 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c6dcb492-424d-4e7a-8524-f0a02d6e367b tempest-VolumesListAdminTestJSON-477560451 None] Lock "cinder-7c9cc1c3-68ce-4acd-b806-1eb7581dd07a-delete_volume" released by "delete_volume" :: held 1.929s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:24 devstack sudo[85588]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e.7e7cc7dd-de04-4c62-8fae-0b19193e0cf3" returned: 0 in 0.514s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:24 devstack sudo[85592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e.info Apr 10 10:35:24 devstack sudo[85592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:24 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-0940e4a1-ed93-4e9f-951c-fff5b60f2475 tempest-VolumesListAdminTestJSON-477560451 None] Acquiring lock "cinder-cfae1d99-b962-438f-9364-fc2a86e73b66-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:24 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-0940e4a1-ed93-4e9f-951c-fff5b60f2475 tempest-VolumesListAdminTestJSON-477560451 None] Lock "cinder-cfae1d99-b962-438f-9364-fc2a86e73b66-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-0940e4a1-ed93-4e9f-951c-fff5b60f2475 tempest-VolumesListAdminTestJSON-477560451 None] Acquiring lock "cinder-quobyte-cfae1d99-b962-438f-9364-fc2a86e73b66" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-0940e4a1-ed93-4e9f-951c-fff5b60f2475 tempest-VolumesListAdminTestJSON-477560451 None] Lock "cinder-quobyte-cfae1d99-b962-438f-9364-fc2a86e73b66" acquired by "delete_volume" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:25 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59523fc-755c-4c45-bc38-cc8051995625]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0940e4a1-ed93-4e9f-951c-fff5b60f2475 tempest-VolumesListAdminTestJSON-477560451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cfae1d99-b962-438f-9364-fc2a86e73b66 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:25 devstack sudo[85594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cfae1d99-b962-438f-9364-fc2a86e73b66 Apr 10 10:35:25 devstack sudo[85594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:25 devstack sudo[85592]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e.info" returned: 0 in 0.501s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:25 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:35:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:25 devstack sudo[85597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e.info Apr 10 10:35:25 devstack sudo[85597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:25 devstack sudo[85594]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0940e4a1-ed93-4e9f-951c-fff5b60f2475 tempest-VolumesListAdminTestJSON-477560451 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cfae1d99-b962-438f-9364-fc2a86e73b66" returned: 0 in 0.583s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0940e4a1-ed93-4e9f-951c-fff5b60f2475 tempest-VolumesListAdminTestJSON-477560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cfae1d99-b962-438f-9364-fc2a86e73b66 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:25 devstack sudo[85602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cfae1d99-b962-438f-9364-fc2a86e73b66 Apr 10 10:35:25 devstack sudo[85602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:25 devstack sudo[85597]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e.info" returned: 0 in 0.470s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Acquiring lock "cinder-quobyte-584fd2e3-f8ac-4a6e-aa98-0f22c8d9f69d" by "_copy_volume_from_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Lock "cinder-quobyte-584fd2e3-f8ac-4a6e-aa98-0f22c8d9f69d" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] snapshot: 7e7cc7dd-de04-4c62-8fae-0b19193e0cf3, volume: 584fd2e3-f8ac-4a6e-aa98-0f22c8d9f69d, {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:35:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:25 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f60bc5-56ba-4ba9-94b3-1ba585028055]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e.7e7cc7dd-de04-4c62-8fae-0b19193e0cf3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:26 devstack sudo[85605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e.7e7cc7dd-de04-4c62-8fae-0b19193e0cf3 Apr 10 10:35:26 devstack sudo[85605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:26 devstack sudo[85602]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0940e4a1-ed93-4e9f-951c-fff5b60f2475 tempest-VolumesListAdminTestJSON-477560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cfae1d99-b962-438f-9364-fc2a86e73b66" returned: 0 in 0.540s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:26 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-0940e4a1-ed93-4e9f-951c-fff5b60f2475 tempest-VolumesListAdminTestJSON-477560451 None] Lock "cinder-quobyte-cfae1d99-b962-438f-9364-fc2a86e73b66" released by "delete_volume" :: held 1.148s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:26 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-0940e4a1-ed93-4e9f-951c-fff5b60f2475 tempest-VolumesListAdminTestJSON-477560451 None] Created reservations ['c5e65613-c38a-497d-bfe6-e59517cd79ae', '3743bf9b-85b5-47f7-a2af-cd579122dc57', '55372e73-2339-4544-b43a-89f80df74ee4', '78f18b98-0a36-41c3-ac0d-a5004e85ad6e'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0940e4a1-ed93-4e9f-951c-fff5b60f2475 tempest-VolumesListAdminTestJSON-477560451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0940e4a1-ed93-4e9f-951c-fff5b60f2475 tempest-VolumesListAdminTestJSON-477560451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:26 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0940e4a1-ed93-4e9f-951c-fff5b60f2475 tempest-VolumesListAdminTestJSON-477560451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:26 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0940e4a1-ed93-4e9f-951c-fff5b60f2475 tempest-VolumesListAdminTestJSON-477560451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0940e4a1-ed93-4e9f-951c-fff5b60f2475 tempest-VolumesListAdminTestJSON-477560451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0940e4a1-ed93-4e9f-951c-fff5b60f2475 tempest-VolumesListAdminTestJSON-477560451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:26 devstack sudo[85608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:35:26 devstack sudo[85608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:26 devstack sudo[85605]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e.7e7cc7dd-de04-4c62-8fae-0b19193e0cf3" returned: 0 in 0.631s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:26 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-968f74b0-b192-4796-8ee8-32dca54f860e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:35:26 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:35:26 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Creating direct copy from snapshot {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:35:26 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[078dfadd-0885-44e6-b734-2978f22e5994]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:26 devstack sudo[85613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e Apr 10 10:35:26 devstack sudo[85613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:26 devstack sudo[85608]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0940e4a1-ed93-4e9f-951c-fff5b60f2475 tempest-VolumesListAdminTestJSON-477560451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.575s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:26 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-0940e4a1-ed93-4e9f-951c-fff5b60f2475 tempest-VolumesListAdminTestJSON-477560451 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:26 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-0940e4a1-ed93-4e9f-951c-fff5b60f2475 tempest-VolumesListAdminTestJSON-477560451 None] Deleted volume successfully. Apr 10 10:35:26 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-0940e4a1-ed93-4e9f-951c-fff5b60f2475 tempest-VolumesListAdminTestJSON-477560451 None] Lock "cinder-cfae1d99-b962-438f-9364-fc2a86e73b66-delete_volume" released by "delete_volume" :: held 1.975s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:27 devstack sudo[85613]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e" returned: 0 in 0.685s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:27 devstack cinder-volume[81938]: DEBUG cinder.utils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Path /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-584fd2e3-f8ac-4a6e-aa98-0f22c8d9f69d not found in is_blk_device check {{(pid=81938) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:35:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-584fd2e3-f8ac-4a6e-aa98-0f22c8d9f69d {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:27 devstack sudo[85619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-584fd2e3-f8ac-4a6e-aa98-0f22c8d9f69d Apr 10 10:35:27 devstack sudo[85619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:29 devstack sudo[85619]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-584fd2e3-f8ac-4a6e-aa98-0f22c8d9f69d" returned: 0 in 2.500s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:29 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad069f76-f488-4ca9-a53d-e02141ec7eb7]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:29 devstack sudo[85631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e Apr 10 10:35:29 devstack sudo[85631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:30 devstack sudo[85631]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e" returned: 0 in 0.762s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:30 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e, size 1024.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-584fd2e3-f8ac-4a6e-aa98-0f22c8d9f69d {{(pid=81938) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:35:30 devstack cinder-volume[81938]: INFO cinder.image.image_utils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Converted 1024.00 MB image at 409.38 MB/s Apr 10 10:35:30 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-584fd2e3-f8ac-4a6e-aa98-0f22c8d9f69d is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:35:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-584fd2e3-f8ac-4a6e-aa98-0f22c8d9f69d {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:30 devstack sudo[85637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-584fd2e3-f8ac-4a6e-aa98-0f22c8d9f69d Apr 10 10:35:30 devstack sudo[85637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:31 devstack sudo[85637]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-584fd2e3-f8ac-4a6e-aa98-0f22c8d9f69d" returned: 0 in 0.523s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:31 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Lock "cinder-quobyte-584fd2e3-f8ac-4a6e-aa98-0f22c8d9f69d" released by "_copy_volume_from_snapshot" :: held 5.168s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:31 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Acquiring lock "cinder-quobyte-7e7cc7dd-de04-4c62-8fae-0b19193e0cf3" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:31 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Lock "cinder-quobyte-7e7cc7dd-de04-4c62-8fae-0b19193e0cf3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:31 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Deleting offline snapshot 7e7cc7dd-de04-4c62-8fae-0b19193e0cf3 of volume 968f74b0-b192-4796-8ee8-32dca54f860e {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:35:31 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] snapshot_file for this snap is: volume-968f74b0-b192-4796-8ee8-32dca54f860e.7e7cc7dd-de04-4c62-8fae-0b19193e0cf3 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:35:31 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[71df1a0d-b41e-4ce0-ab37-b5453e8eb15d]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e.7e7cc7dd-de04-4c62-8fae-0b19193e0cf3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:31 devstack sudo[85642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e.7e7cc7dd-de04-4c62-8fae-0b19193e0cf3 Apr 10 10:35:31 devstack sudo[85642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:31 devstack sudo[85642]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e.7e7cc7dd-de04-4c62-8fae-0b19193e0cf3" returned: 0 in 0.652s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:31 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-968f74b0-b192-4796-8ee8-32dca54f860e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:35:31 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae96a4c-b7ae-4286-9853-28048356f2c2]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:31 devstack sudo[85647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e Apr 10 10:35:31 devstack sudo[85647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:32 devstack sudo[85647]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e" returned: 0 in 0.658s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e.7e7cc7dd-de04-4c62-8fae-0b19193e0cf3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:32 devstack sudo[85652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e.7e7cc7dd-de04-4c62-8fae-0b19193e0cf3 Apr 10 10:35:32 devstack sudo[85652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:33 devstack sudo[85652]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e.7e7cc7dd-de04-4c62-8fae-0b19193e0cf3" returned: 0 in 0.662s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e.7e7cc7dd-de04-4c62-8fae-0b19193e0cf3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:33 devstack sudo[85657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e.7e7cc7dd-de04-4c62-8fae-0b19193e0cf3 Apr 10 10:35:33 devstack sudo[85657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:33 devstack sudo[85657]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e.7e7cc7dd-de04-4c62-8fae-0b19193e0cf3" returned: 0 in 0.578s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:33 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Lock "cinder-quobyte-7e7cc7dd-de04-4c62-8fae-0b19193e0cf3" released by "_delete_snapshot" :: held 2.624s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.258s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.711s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:33 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1046306588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77afffa6-b034-44a8-b915-b59fede42c2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdc2bb62cc5c4341b9529571f0e9368f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:23Z,use_quota=True,user_id='10714356e73841b5a80acc068652dd05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d260b96f-9b8a-446c-94a5-a68e4994c26e),volume_type_id=d260b96f-9b8a-446c-94a5-a68e4994c26e)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:33 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] Creating volume 77afffa6-b034-44a8-b915-b59fede42c2f {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:33 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:33 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:33 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:33 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:35:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-77afffa6-b034-44a8-b915-b59fede42c2f 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:33 devstack sudo[85660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-77afffa6-b034-44a8-b915-b59fede42c2f 1073741824 Apr 10 10:35:33 devstack sudo[85660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:33 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-4755a857-e509-41a9-9363-a1088cd42d8c tempest-GroupsV314Test-346698735 None] Create group from source-group-371f6acf-1841-402d-8a97-692e1dabfae9 completed successfully. Apr 10 10:35:33 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] Flow 'volume_create_manager' (37ad92f2-48a1-4c9a-88aa-29406702c68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e1a308-7726-4bb5-92da-a44f8b0a6701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e1a308-7726-4bb5-92da-a44f8b0a6701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1186857035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe44c5fe-7f95-456f-b304-8cc14d874988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1406b33d743e41c3a0d2fe19c45fcdd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:34Z,use_quota=True,user_id='2a796894c70a4fedb6b920c8c9d2dcf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa3a0aa-37b9-4c16-935a-8134d3962b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa3a0aa-37b9-4c16-935a-8134d3962b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41e1b76f-1033-4719-9871-ff71e96b7d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41e1b76f-1033-4719-9871-ff71e96b7d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe44c5fe-7f95-456f-b304-8cc14d874988', 'volume_name': 'volume-fe44c5fe-7f95-456f-b304-8cc14d874988', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e2d645-5dc8-478c-b8c5-53f717d52f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e2d645-5dc8-478c-b8c5-53f717d52f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f1a3d6-0965-4052-93db-1a0080e0ca01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:33 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] Volume fe44c5fe-7f95-456f-b304-8cc14d874988: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe44c5fe-7f95-456f-b304-8cc14d874988', 'volume_size': 1} Apr 10 10:35:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:34 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f1a21987-cdee-4a92-b5ae-45c7a898d2ce tempest-GroupsV314Test-346698735 None] Acquiring lock "cinder-quobyte-584fd2e3-f8ac-4a6e-aa98-0f22c8d9f69d" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:34 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f1a21987-cdee-4a92-b5ae-45c7a898d2ce tempest-GroupsV314Test-346698735 None] Lock "cinder-quobyte-584fd2e3-f8ac-4a6e-aa98-0f22c8d9f69d" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:34 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ca16a5-fb6d-4997-9952-f324e5511fc5]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f1a21987-cdee-4a92-b5ae-45c7a898d2ce tempest-GroupsV314Test-346698735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-584fd2e3-f8ac-4a6e-aa98-0f22c8d9f69d {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:34 devstack sudo[85662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-584fd2e3-f8ac-4a6e-aa98-0f22c8d9f69d Apr 10 10:35:34 devstack sudo[85662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:34 devstack sudo[85660]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-77afffa6-b034-44a8-b915-b59fede42c2f 1073741824" returned: 0 in 0.718s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-77afffa6-b034-44a8-b915-b59fede42c2f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:34 devstack sudo[85667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-77afffa6-b034-44a8-b915-b59fede42c2f Apr 10 10:35:34 devstack sudo[85667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:34 devstack sudo[85662]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f1a21987-cdee-4a92-b5ae-45c7a898d2ce tempest-GroupsV314Test-346698735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-584fd2e3-f8ac-4a6e-aa98-0f22c8d9f69d" returned: 0 in 0.590s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f1a21987-cdee-4a92-b5ae-45c7a898d2ce tempest-GroupsV314Test-346698735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-584fd2e3-f8ac-4a6e-aa98-0f22c8d9f69d {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:34 devstack sudo[85672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-584fd2e3-f8ac-4a6e-aa98-0f22c8d9f69d Apr 10 10:35:34 devstack sudo[85672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:34 devstack sudo[85667]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-77afffa6-b034-44a8-b915-b59fede42c2f" returned: 0 in 0.548s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:34 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.033s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:35 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1186857035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe44c5fe-7f95-456f-b304-8cc14d874988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1406b33d743e41c3a0d2fe19c45fcdd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:34Z,use_quota=True,user_id='2a796894c70a4fedb6b920c8c9d2dcf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:35 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] Creating volume fe44c5fe-7f95-456f-b304-8cc14d874988 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:35 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:35 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:35 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:35 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:35:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-fe44c5fe-7f95-456f-b304-8cc14d874988 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf79809-9e23-4676-8551-513ae75f919d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77afffa6-b034-44a8-b915-b59fede42c2f', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:35 devstack sudo[85675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-fe44c5fe-7f95-456f-b304-8cc14d874988 1073741824 Apr 10 10:35:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f5bdec-1d8c-4891-97ce-cf0cce69cd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:35 devstack sudo[85675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:35 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] Volume volume-77afffa6-b034-44a8-b915-b59fede42c2f (77afffa6-b034-44a8-b915-b59fede42c2f): created successfully Apr 10 10:35:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f5bdec-1d8c-4891-97ce-cf0cce69cd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] Flow 'volume_create_manager' (aaa16d4f-ae99-4daf-a2d6-72568ebb5360) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:35 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-5e5bf861-66c5-40eb-b97f-7ff92d79e5fc tempest-VolumeTypesAccessTest-779410359 None] Created volume successfully. Apr 10 10:35:35 devstack sudo[85672]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f1a21987-cdee-4a92-b5ae-45c7a898d2ce tempest-GroupsV314Test-346698735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-584fd2e3-f8ac-4a6e-aa98-0f22c8d9f69d" returned: 0 in 0.580s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:35 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f1a21987-cdee-4a92-b5ae-45c7a898d2ce tempest-GroupsV314Test-346698735 None] Lock "cinder-quobyte-584fd2e3-f8ac-4a6e-aa98-0f22c8d9f69d" released by "delete_volume" :: held 1.195s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:35 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-f1a21987-cdee-4a92-b5ae-45c7a898d2ce tempest-GroupsV314Test-346698735 None] Created reservations ['fc307be2-5424-4795-94f3-5c028cb51d7a'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:35 devstack cinder-volume[81938]: WARNING cinder.quota [None req-f1a21987-cdee-4a92-b5ae-45c7a898d2ce tempest-GroupsV314Test-346698735 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1700302682 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1700302682, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:35:35 devstack cinder-volume[81938]: WARNING cinder.quota [None req-f1a21987-cdee-4a92-b5ae-45c7a898d2ce tempest-GroupsV314Test-346698735 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1700302682 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1700302682, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:35:35 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-f1a21987-cdee-4a92-b5ae-45c7a898d2ce tempest-GroupsV314Test-346698735 None] Created reservations ['e663e701-7403-4e37-ba8c-138d0ef9b41c', '79989b50-4b66-4151-9208-ed30daf01f34', '8ad5f395-5c43-45eb-8041-a95ec7104712', 'fcfad9e4-d88d-4965-af23-0d82ac766917'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f1a21987-cdee-4a92-b5ae-45c7a898d2ce tempest-GroupsV314Test-346698735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f1a21987-cdee-4a92-b5ae-45c7a898d2ce tempest-GroupsV314Test-346698735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:35 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f1a21987-cdee-4a92-b5ae-45c7a898d2ce tempest-GroupsV314Test-346698735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:35 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f1a21987-cdee-4a92-b5ae-45c7a898d2ce tempest-GroupsV314Test-346698735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f1a21987-cdee-4a92-b5ae-45c7a898d2ce tempest-GroupsV314Test-346698735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f1a21987-cdee-4a92-b5ae-45c7a898d2ce tempest-GroupsV314Test-346698735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:35 devstack sudo[85680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:35:35 devstack sudo[85680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:35 devstack sudo[85675]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-fe44c5fe-7f95-456f-b304-8cc14d874988 1073741824" returned: 0 in 0.617s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-fe44c5fe-7f95-456f-b304-8cc14d874988 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:35 devstack sudo[85683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-fe44c5fe-7f95-456f-b304-8cc14d874988 Apr 10 10:35:35 devstack sudo[85683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f1a21987-cdee-4a92-b5ae-45c7a898d2ce tempest-GroupsV314Test-346698735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.490s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:35 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-f1a21987-cdee-4a92-b5ae-45c7a898d2ce tempest-GroupsV314Test-346698735 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:35 devstack sudo[85680]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:35 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-f1a21987-cdee-4a92-b5ae-45c7a898d2ce tempest-GroupsV314Test-346698735 None] Delete group completed successfully. Apr 10 10:35:36 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-d36b728b-b817-4edc-94ed-836b694b7e9d tempest-VolumeTypesAccessTest-779410359 None] Acquiring lock "cinder-77afffa6-b034-44a8-b915-b59fede42c2f-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:36 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-d36b728b-b817-4edc-94ed-836b694b7e9d tempest-VolumeTypesAccessTest-779410359 None] Lock "cinder-77afffa6-b034-44a8-b915-b59fede42c2f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:36 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-d36b728b-b817-4edc-94ed-836b694b7e9d tempest-VolumeTypesAccessTest-779410359 None] Acquiring lock "cinder-quobyte-77afffa6-b034-44a8-b915-b59fede42c2f" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:36 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-d36b728b-b817-4edc-94ed-836b694b7e9d tempest-VolumeTypesAccessTest-779410359 None] Lock "cinder-quobyte-77afffa6-b034-44a8-b915-b59fede42c2f" acquired by "delete_volume" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:36 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[45de5e94-3968-48f2-bbce-32e518b75f24]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d36b728b-b817-4edc-94ed-836b694b7e9d tempest-VolumeTypesAccessTest-779410359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-77afffa6-b034-44a8-b915-b59fede42c2f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:36 devstack sudo[85683]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-fe44c5fe-7f95-456f-b304-8cc14d874988" returned: 0 in 0.515s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:36 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f1a3d6-0965-4052-93db-1a0080e0ca01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe44c5fe-7f95-456f-b304-8cc14d874988', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3a446f-9e83-48ef-be88-c80d90b98d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:36 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] Volume volume-fe44c5fe-7f95-456f-b304-8cc14d874988 (fe44c5fe-7f95-456f-b304-8cc14d874988): created successfully Apr 10 10:35:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3a446f-9e83-48ef-be88-c80d90b98d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] Flow 'volume_create_manager' (37ad92f2-48a1-4c9a-88aa-29406702c68d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:36 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-d6c15222-58b6-4f47-a38d-36a843dc2ef6 tempest-VolumesMetadataTest-1323456416 None] Created volume successfully. Apr 10 10:35:36 devstack sudo[85687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-77afffa6-b034-44a8-b915-b59fede42c2f Apr 10 10:35:36 devstack sudo[85687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:36 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-1769b9f9-2bb7-4b2e-8937-cc19d0bb8f4f tempest-GroupsV314Test-346698735 None] Acquiring lock "cinder-quobyte-968f74b0-b192-4796-8ee8-32dca54f860e" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:36 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-1769b9f9-2bb7-4b2e-8937-cc19d0bb8f4f tempest-GroupsV314Test-346698735 None] Lock "cinder-quobyte-968f74b0-b192-4796-8ee8-32dca54f860e" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:36 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37060a7-bbbc-4e0b-8944-2113a64e1983]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1769b9f9-2bb7-4b2e-8937-cc19d0bb8f4f tempest-GroupsV314Test-346698735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:36 devstack sudo[85689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e Apr 10 10:35:36 devstack sudo[85689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:36 devstack sudo[85687]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d36b728b-b817-4edc-94ed-836b694b7e9d tempest-VolumeTypesAccessTest-779410359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-77afffa6-b034-44a8-b915-b59fede42c2f" returned: 0 in 0.570s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d36b728b-b817-4edc-94ed-836b694b7e9d tempest-VolumeTypesAccessTest-779410359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-77afffa6-b034-44a8-b915-b59fede42c2f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:36 devstack sudo[85694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-77afffa6-b034-44a8-b915-b59fede42c2f Apr 10 10:35:36 devstack sudo[85694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:37 devstack sudo[85689]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1769b9f9-2bb7-4b2e-8937-cc19d0bb8f4f tempest-GroupsV314Test-346698735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e" returned: 0 in 0.635s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1769b9f9-2bb7-4b2e-8937-cc19d0bb8f4f tempest-GroupsV314Test-346698735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:37 devstack sudo[85700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e Apr 10 10:35:37 devstack sudo[85700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:37 devstack sudo[85694]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d36b728b-b817-4edc-94ed-836b694b7e9d tempest-VolumeTypesAccessTest-779410359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-77afffa6-b034-44a8-b915-b59fede42c2f" returned: 0 in 0.591s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:37 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-d36b728b-b817-4edc-94ed-836b694b7e9d tempest-VolumeTypesAccessTest-779410359 None] Lock "cinder-quobyte-77afffa6-b034-44a8-b915-b59fede42c2f" released by "delete_volume" :: held 1.194s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:37 devstack cinder-volume[81938]: WARNING cinder.quota [None req-d36b728b-b817-4edc-94ed-836b694b7e9d tempest-VolumeTypesAccessTest-779410359 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1281322971 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1281322971, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:35:37 devstack cinder-volume[81938]: WARNING cinder.quota [None req-d36b728b-b817-4edc-94ed-836b694b7e9d tempest-VolumeTypesAccessTest-779410359 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1281322971 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1281322971, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:35:37 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-d36b728b-b817-4edc-94ed-836b694b7e9d tempest-VolumeTypesAccessTest-779410359 None] Created reservations ['1a865c0a-e687-4600-9392-e207c502a4df', '8b3391dc-e6df-4485-a279-b5a22e0bd076', '7b300257-74bc-4ba8-bb14-4115a9ad91e0', '996ed9dd-1512-413b-90ca-79457c0485ce'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d36b728b-b817-4edc-94ed-836b694b7e9d tempest-VolumeTypesAccessTest-779410359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d36b728b-b817-4edc-94ed-836b694b7e9d tempest-VolumeTypesAccessTest-779410359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:37 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-d36b728b-b817-4edc-94ed-836b694b7e9d tempest-VolumeTypesAccessTest-779410359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:37 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-d36b728b-b817-4edc-94ed-836b694b7e9d tempest-VolumeTypesAccessTest-779410359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d36b728b-b817-4edc-94ed-836b694b7e9d tempest-VolumeTypesAccessTest-779410359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d36b728b-b817-4edc-94ed-836b694b7e9d tempest-VolumeTypesAccessTest-779410359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:37 devstack sudo[85702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:35:37 devstack sudo[85702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:37 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-8e7f12ad-34bb-436a-bf1b-d0787f573f99 tempest-VolumesMetadataTest-1323456416 None] Acquiring lock "cinder-fe44c5fe-7f95-456f-b304-8cc14d874988-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:37 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-8e7f12ad-34bb-436a-bf1b-d0787f573f99 tempest-VolumesMetadataTest-1323456416 None] Lock "cinder-fe44c5fe-7f95-456f-b304-8cc14d874988-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:37 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-8e7f12ad-34bb-436a-bf1b-d0787f573f99 tempest-VolumesMetadataTest-1323456416 None] Acquiring lock "cinder-quobyte-fe44c5fe-7f95-456f-b304-8cc14d874988" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:37 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-8e7f12ad-34bb-436a-bf1b-d0787f573f99 tempest-VolumesMetadataTest-1323456416 None] Lock "cinder-quobyte-fe44c5fe-7f95-456f-b304-8cc14d874988" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:37 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a03e7a-6919-46d7-a132-38a211e160c2]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8e7f12ad-34bb-436a-bf1b-d0787f573f99 tempest-VolumesMetadataTest-1323456416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-fe44c5fe-7f95-456f-b304-8cc14d874988 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:37 devstack sudo[85700]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1769b9f9-2bb7-4b2e-8937-cc19d0bb8f4f tempest-GroupsV314Test-346698735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-968f74b0-b192-4796-8ee8-32dca54f860e" returned: 0 in 0.766s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:37 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-1769b9f9-2bb7-4b2e-8937-cc19d0bb8f4f tempest-GroupsV314Test-346698735 None] Lock "cinder-quobyte-968f74b0-b192-4796-8ee8-32dca54f860e" released by "delete_volume" :: held 1.449s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:37 devstack sudo[85705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-fe44c5fe-7f95-456f-b304-8cc14d874988 Apr 10 10:35:37 devstack sudo[85705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:37 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-1769b9f9-2bb7-4b2e-8937-cc19d0bb8f4f tempest-GroupsV314Test-346698735 None] Created reservations ['8e2afbff-b375-453e-8b17-b4d5346d596d'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:38 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-1769b9f9-2bb7-4b2e-8937-cc19d0bb8f4f tempest-GroupsV314Test-346698735 None] Created reservations ['6d7de867-3bc7-4a84-af52-8fd1f3917472', '0f3d8f50-0058-4ba5-8341-58eb594aa8da', 'aa4c560f-6f92-494b-9d34-b1a2ca4ff755', '5ac2681b-4260-4c94-b563-6e38eb48e5dd'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1769b9f9-2bb7-4b2e-8937-cc19d0bb8f4f tempest-GroupsV314Test-346698735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1769b9f9-2bb7-4b2e-8937-cc19d0bb8f4f tempest-GroupsV314Test-346698735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:38 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1769b9f9-2bb7-4b2e-8937-cc19d0bb8f4f tempest-GroupsV314Test-346698735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:38 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1769b9f9-2bb7-4b2e-8937-cc19d0bb8f4f tempest-GroupsV314Test-346698735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1769b9f9-2bb7-4b2e-8937-cc19d0bb8f4f tempest-GroupsV314Test-346698735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1769b9f9-2bb7-4b2e-8937-cc19d0bb8f4f tempest-GroupsV314Test-346698735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:38 devstack sudo[85708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:35:38 devstack sudo[85708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:38 devstack sudo[85702]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d36b728b-b817-4edc-94ed-836b694b7e9d tempest-VolumeTypesAccessTest-779410359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.767s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:38 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-d36b728b-b817-4edc-94ed-836b694b7e9d tempest-VolumeTypesAccessTest-779410359 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:38 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-d36b728b-b817-4edc-94ed-836b694b7e9d tempest-VolumeTypesAccessTest-779410359 None] Deleted volume successfully. Apr 10 10:35:38 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-d36b728b-b817-4edc-94ed-836b694b7e9d tempest-VolumeTypesAccessTest-779410359 None] Lock "cinder-77afffa6-b034-44a8-b915-b59fede42c2f-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:38 devstack sudo[85705]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8e7f12ad-34bb-436a-bf1b-d0787f573f99 tempest-VolumesMetadataTest-1323456416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-fe44c5fe-7f95-456f-b304-8cc14d874988" returned: 0 in 0.667s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8e7f12ad-34bb-436a-bf1b-d0787f573f99 tempest-VolumesMetadataTest-1323456416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-fe44c5fe-7f95-456f-b304-8cc14d874988 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:38 devstack sudo[85714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-fe44c5fe-7f95-456f-b304-8cc14d874988 Apr 10 10:35:38 devstack sudo[85714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:38 devstack sudo[85708]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1769b9f9-2bb7-4b2e-8937-cc19d0bb8f4f tempest-GroupsV314Test-346698735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.566s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:38 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-1769b9f9-2bb7-4b2e-8937-cc19d0bb8f4f tempest-GroupsV314Test-346698735 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:38 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-1769b9f9-2bb7-4b2e-8937-cc19d0bb8f4f tempest-GroupsV314Test-346698735 None] Delete group completed successfully. Apr 10 10:35:39 devstack sudo[85714]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8e7f12ad-34bb-436a-bf1b-d0787f573f99 tempest-VolumesMetadataTest-1323456416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-fe44c5fe-7f95-456f-b304-8cc14d874988" returned: 0 in 0.552s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:39 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-8e7f12ad-34bb-436a-bf1b-d0787f573f99 tempest-VolumesMetadataTest-1323456416 None] Lock "cinder-quobyte-fe44c5fe-7f95-456f-b304-8cc14d874988" released by "delete_volume" :: held 1.246s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:39 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-8e7f12ad-34bb-436a-bf1b-d0787f573f99 tempest-VolumesMetadataTest-1323456416 None] Created reservations ['cd921261-329a-4ae9-afcf-f20337928a0f', '7b94a05e-818f-4420-9359-5f9d0c3de531', '3d75a7f1-e03d-4fde-afbd-bdfa70abc42b', '8ae0ac94-da66-467e-9127-2f548046fec9'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8e7f12ad-34bb-436a-bf1b-d0787f573f99 tempest-VolumesMetadataTest-1323456416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8e7f12ad-34bb-436a-bf1b-d0787f573f99 tempest-VolumesMetadataTest-1323456416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:39 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-8e7f12ad-34bb-436a-bf1b-d0787f573f99 tempest-VolumesMetadataTest-1323456416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:39 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-8e7f12ad-34bb-436a-bf1b-d0787f573f99 tempest-VolumesMetadataTest-1323456416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8e7f12ad-34bb-436a-bf1b-d0787f573f99 tempest-VolumesMetadataTest-1323456416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8e7f12ad-34bb-436a-bf1b-d0787f573f99 tempest-VolumesMetadataTest-1323456416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:39 devstack sudo[85717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:35:39 devstack sudo[85717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:39 devstack sudo[85717]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8e7f12ad-34bb-436a-bf1b-d0787f573f99 tempest-VolumesMetadataTest-1323456416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.548s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:39 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-8e7f12ad-34bb-436a-bf1b-d0787f573f99 tempest-VolumesMetadataTest-1323456416 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:39 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-8e7f12ad-34bb-436a-bf1b-d0787f573f99 tempest-VolumesMetadataTest-1323456416 None] Deleted volume successfully. Apr 10 10:35:39 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-8e7f12ad-34bb-436a-bf1b-d0787f573f99 tempest-VolumesMetadataTest-1323456416 None] Lock "cinder-fe44c5fe-7f95-456f-b304-8cc14d874988-delete_volume" released by "delete_volume" :: held 1.988s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:45 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] Flow 'volume_create_manager' (d55597ce-26a5-4373-8fef-3059fb728079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b67298f5-990f-456a-b2cf-dfddae442e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b67298f5-990f-456a-b2cf-dfddae442e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-313968953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eb5801a-4b97-4628-a7f2-2985f0eaddc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5daac84d61b4f7cbf0c3d4da741846d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:46Z,use_quota=True,user_id='a5ea3530a19247e48a31270ab40e7d77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39ffee2c-20ef-4af4-9df0-7734658faa60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39ffee2c-20ef-4af4-9df0-7734658faa60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c80e4d0c-bfba-4ccd-830c-21175efe8de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c80e4d0c-bfba-4ccd-830c-21175efe8de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eb5801a-4b97-4628-a7f2-2985f0eaddc0', 'volume_name': 'volume-8eb5801a-4b97-4628-a7f2-2985f0eaddc0', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a5d04cb-540f-43e6-a4a4-ad5e02d2f8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a5d04cb-540f-43e6-a4a4-ad5e02d2f8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6af9068-babb-4fbc-bfb7-dd2af6450224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:45 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] Volume 8eb5801a-4b97-4628-a7f2-2985f0eaddc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eb5801a-4b97-4628-a7f2-2985f0eaddc0', 'volume_size': 1} Apr 10 10:35:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:45 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-313968953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eb5801a-4b97-4628-a7f2-2985f0eaddc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5daac84d61b4f7cbf0c3d4da741846d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:46Z,use_quota=True,user_id='a5ea3530a19247e48a31270ab40e7d77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:45 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] Creating volume 8eb5801a-4b97-4628-a7f2-2985f0eaddc0 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:45 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:45 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:45 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:45 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:35:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8eb5801a-4b97-4628-a7f2-2985f0eaddc0 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:45 devstack sudo[85721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8eb5801a-4b97-4628-a7f2-2985f0eaddc0 1073741824 Apr 10 10:35:45 devstack sudo[85721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:46 devstack sudo[85721]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8eb5801a-4b97-4628-a7f2-2985f0eaddc0 1073741824" returned: 0 in 0.675s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8eb5801a-4b97-4628-a7f2-2985f0eaddc0 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:46 devstack sudo[85726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8eb5801a-4b97-4628-a7f2-2985f0eaddc0 Apr 10 10:35:46 devstack sudo[85726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:46 devstack sudo[85726]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8eb5801a-4b97-4628-a7f2-2985f0eaddc0" returned: 0 in 0.547s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:46 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6af9068-babb-4fbc-bfb7-dd2af6450224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eb5801a-4b97-4628-a7f2-2985f0eaddc0', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f3293a-efe6-4856-b5a5-05f424150d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:46 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] Volume volume-8eb5801a-4b97-4628-a7f2-2985f0eaddc0 (8eb5801a-4b97-4628-a7f2-2985f0eaddc0): created successfully Apr 10 10:35:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f3293a-efe6-4856-b5a5-05f424150d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] Flow 'volume_create_manager' (d55597ce-26a5-4373-8fef-3059fb728079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:46 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-12caf9ae-b53a-4002-8871-7a3f07493648 tempest-VolumesTransfersV355Test-2065874467 None] Created volume successfully. Apr 10 10:35:48 devstack cinder-volume[81938]: DEBUG oslo_service.periodic_task [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81938) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:35:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:48 devstack sudo[85729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:35:48 devstack sudo[85729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:48 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-09914488-8b77-408d-93fe-bf151a73461e tempest-VolumesTransfersV355Test-639327618 None] Transfer volume completed successfully. Apr 10 10:35:48 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:48 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] Flow 'volume_create_manager' (f955a4fb-ed11-4575-b3d9-182209299457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:48 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b00561c-3e3d-420d-ae21-6a81077c4914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:48 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b00561c-3e3d-420d-ae21-6a81077c4914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-498808240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3c417df-6188-4656-81b5-08e79ee6c8d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e18b57325a7a465eb96c55a52c0931aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:48Z,use_quota=True,user_id='bf7680f7a6314bc380bd3c6198b578cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:48 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8038772-81db-42da-8c03-c76b1163ba5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:48 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8038772-81db-42da-8c03-c76b1163ba5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:48 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51053e28-dc82-453d-aa53-c33f8fd5d9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:48 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51053e28-dc82-453d-aa53-c33f8fd5d9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3c417df-6188-4656-81b5-08e79ee6c8d5', 'volume_name': 'volume-a3c417df-6188-4656-81b5-08e79ee6c8d5', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:48 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3062cb48-0609-4fb1-b33b-a57867fc0594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:48 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3062cb48-0609-4fb1-b33b-a57867fc0594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:48 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c224a21-df21-4845-abbb-e1fcdf6f6edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:48 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] Volume a3c417df-6188-4656-81b5-08e79ee6c8d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3c417df-6188-4656-81b5-08e79ee6c8d5', 'volume_size': 1} Apr 10 10:35:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-498808240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3c417df-6188-4656-81b5-08e79ee6c8d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e18b57325a7a465eb96c55a52c0931aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:48Z,use_quota=True,user_id='bf7680f7a6314bc380bd3c6198b578cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] Creating volume a3c417df-6188-4656-81b5-08e79ee6c8d5 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:48 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:35:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a3c417df-6188-4656-81b5-08e79ee6c8d5 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:48 devstack sudo[85731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a3c417df-6188-4656-81b5-08e79ee6c8d5 1073741824 Apr 10 10:35:48 devstack sudo[85731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:48 devstack sudo[85729]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.771s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:48 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:49 devstack sudo[85731]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a3c417df-6188-4656-81b5-08e79ee6c8d5 1073741824" returned: 0 in 0.720s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a3c417df-6188-4656-81b5-08e79ee6c8d5 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:49 devstack sudo[85743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a3c417df-6188-4656-81b5-08e79ee6c8d5 Apr 10 10:35:49 devstack sudo[85743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:49 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a589cb17-2ca3-45ed-af5c-1687ce29aa13 tempest-VolumesTransfersV355Test-2140444755 None] Acquiring lock "cinder-8eb5801a-4b97-4628-a7f2-2985f0eaddc0-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:49 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a589cb17-2ca3-45ed-af5c-1687ce29aa13 tempest-VolumesTransfersV355Test-2140444755 None] Lock "cinder-8eb5801a-4b97-4628-a7f2-2985f0eaddc0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:49 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a589cb17-2ca3-45ed-af5c-1687ce29aa13 tempest-VolumesTransfersV355Test-2140444755 None] Acquiring lock "cinder-quobyte-8eb5801a-4b97-4628-a7f2-2985f0eaddc0" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:49 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a589cb17-2ca3-45ed-af5c-1687ce29aa13 tempest-VolumesTransfersV355Test-2140444755 None] Lock "cinder-quobyte-8eb5801a-4b97-4628-a7f2-2985f0eaddc0" acquired by "delete_volume" :: waited 0.038s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:49 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0f5e71-782d-490a-ac6d-a24214777ed8]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a589cb17-2ca3-45ed-af5c-1687ce29aa13 tempest-VolumesTransfersV355Test-2140444755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8eb5801a-4b97-4628-a7f2-2985f0eaddc0 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:49 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Flow 'volume_create_manager' (a5a75ef6-5f99-4439-9e28-0fab1ecd2206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c07af596-6665-4aae-a92a-e157483013d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:49 devstack sudo[85745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8eb5801a-4b97-4628-a7f2-2985f0eaddc0 Apr 10 10:35:49 devstack sudo[85745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c07af596-6665-4aae-a92a-e157483013d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-687976408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18df322-7c48-43b3-b988-e6813dd49c15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeebb640a9bb48669edb67d9f4a3a6a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:50Z,use_quota=True,user_id='b69ff7f891884a0eae8a48627011790f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (912f05ff-1d27-4b6c-9feb-2fd161fca4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (912f05ff-1d27-4b6c-9feb-2fd161fca4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dc5a63d-74bd-4de4-a029-8a9cb4d542f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dc5a63d-74bd-4de4-a029-8a9cb4d542f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b18df322-7c48-43b3-b988-e6813dd49c15', 'volume_name': 'volume-b18df322-7c48-43b3-b988-e6813dd49c15', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70392d1c-8001-4d33-85f8-9dc01471175b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70392d1c-8001-4d33-85f8-9dc01471175b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d5afbb-64f2-45c4-94cc-4d9d091d8f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:49 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Volume b18df322-7c48-43b3-b988-e6813dd49c15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b18df322-7c48-43b3-b988-e6813dd49c15', 'volume_size': 1} Apr 10 10:35:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:50 devstack sudo[85743]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a3c417df-6188-4656-81b5-08e79ee6c8d5" returned: 0 in 0.645s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:50 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.167s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:50 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-687976408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18df322-7c48-43b3-b988-e6813dd49c15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeebb640a9bb48669edb67d9f4a3a6a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:50Z,use_quota=True,user_id='b69ff7f891884a0eae8a48627011790f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:50 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Creating volume b18df322-7c48-43b3-b988-e6813dd49c15 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:50 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:50 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:50 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:50 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:35:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c224a21-df21-4845-abbb-e1fcdf6f6edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3c417df-6188-4656-81b5-08e79ee6c8d5', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ce14e6-5970-4697-a236-19f5b2e81dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:50 devstack sudo[85749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15 1073741824 Apr 10 10:35:50 devstack sudo[85749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:50 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] Volume volume-a3c417df-6188-4656-81b5-08e79ee6c8d5 (a3c417df-6188-4656-81b5-08e79ee6c8d5): created successfully Apr 10 10:35:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ce14e6-5970-4697-a236-19f5b2e81dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] Flow 'volume_create_manager' (f955a4fb-ed11-4575-b3d9-182209299457) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:50 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-b503db74-a0ee-439a-84e1-1764ac3d52af tempest-VolumeQuotasAdminTestJSON-1733974360 None] Created volume successfully. Apr 10 10:35:50 devstack sudo[85745]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a589cb17-2ca3-45ed-af5c-1687ce29aa13 tempest-VolumesTransfersV355Test-2140444755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8eb5801a-4b97-4628-a7f2-2985f0eaddc0" returned: 0 in 0.752s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a589cb17-2ca3-45ed-af5c-1687ce29aa13 tempest-VolumesTransfersV355Test-2140444755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8eb5801a-4b97-4628-a7f2-2985f0eaddc0 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:50 devstack sudo[85754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8eb5801a-4b97-4628-a7f2-2985f0eaddc0 Apr 10 10:35:50 devstack sudo[85754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:50 devstack sudo[85749]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15 1073741824" returned: 0 in 0.797s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:50 devstack sudo[85760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15 Apr 10 10:35:50 devstack sudo[85760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:50 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-980fdab0-4d5d-4b31-969d-b83674bce32a tempest-VolumeQuotasAdminTestJSON-1733974360 None] Acquiring lock "cinder-a3c417df-6188-4656-81b5-08e79ee6c8d5-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:50 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-980fdab0-4d5d-4b31-969d-b83674bce32a tempest-VolumeQuotasAdminTestJSON-1733974360 None] Lock "cinder-a3c417df-6188-4656-81b5-08e79ee6c8d5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:51 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-980fdab0-4d5d-4b31-969d-b83674bce32a tempest-VolumeQuotasAdminTestJSON-1733974360 None] Acquiring lock "cinder-quobyte-a3c417df-6188-4656-81b5-08e79ee6c8d5" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:51 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-980fdab0-4d5d-4b31-969d-b83674bce32a tempest-VolumeQuotasAdminTestJSON-1733974360 None] Lock "cinder-quobyte-a3c417df-6188-4656-81b5-08e79ee6c8d5" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:51 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b0ba62-a8de-4c7a-bc84-380bbbb1d5e5]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-980fdab0-4d5d-4b31-969d-b83674bce32a tempest-VolumeQuotasAdminTestJSON-1733974360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a3c417df-6188-4656-81b5-08e79ee6c8d5 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:51 devstack sudo[85762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a3c417df-6188-4656-81b5-08e79ee6c8d5 Apr 10 10:35:51 devstack sudo[85762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:51 devstack sudo[85754]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a589cb17-2ca3-45ed-af5c-1687ce29aa13 tempest-VolumesTransfersV355Test-2140444755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8eb5801a-4b97-4628-a7f2-2985f0eaddc0" returned: 0 in 0.821s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:51 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a589cb17-2ca3-45ed-af5c-1687ce29aa13 tempest-VolumesTransfersV355Test-2140444755 None] Lock "cinder-quobyte-8eb5801a-4b97-4628-a7f2-2985f0eaddc0" released by "delete_volume" :: held 1.601s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:51 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-a589cb17-2ca3-45ed-af5c-1687ce29aa13 tempest-VolumesTransfersV355Test-2140444755 None] Created reservations ['2602644b-0b35-4a96-bd96-24a026edfc49', '40db8fc1-7b82-4e65-a4da-51b22083568b', '66545d02-db99-4159-b2db-53bc54ca3122', '17c34081-f265-4d88-90e3-6ad42ca7242a'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a589cb17-2ca3-45ed-af5c-1687ce29aa13 tempest-VolumesTransfersV355Test-2140444755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a589cb17-2ca3-45ed-af5c-1687ce29aa13 tempest-VolumesTransfersV355Test-2140444755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:51 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a589cb17-2ca3-45ed-af5c-1687ce29aa13 tempest-VolumesTransfersV355Test-2140444755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:51 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a589cb17-2ca3-45ed-af5c-1687ce29aa13 tempest-VolumesTransfersV355Test-2140444755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a589cb17-2ca3-45ed-af5c-1687ce29aa13 tempest-VolumesTransfersV355Test-2140444755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a589cb17-2ca3-45ed-af5c-1687ce29aa13 tempest-VolumesTransfersV355Test-2140444755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:51 devstack sudo[85766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:35:51 devstack sudo[85766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:51 devstack sudo[85760]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15" returned: 0 in 0.610s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:51 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] <== create_volume: return (1449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d5afbb-64f2-45c4-94cc-4d9d091d8f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b18df322-7c48-43b3-b988-e6813dd49c15', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f74c23e-0f16-4a0c-93d9-c34fccce3ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:51 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Volume volume-b18df322-7c48-43b3-b988-e6813dd49c15 (b18df322-7c48-43b3-b988-e6813dd49c15): created successfully Apr 10 10:35:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f74c23e-0f16-4a0c-93d9-c34fccce3ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Flow 'volume_create_manager' (a5a75ef6-5f99-4439-9e28-0fab1ecd2206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:51 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-6f6cd974-b8e2-4725-b00a-44a6157ae18f tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Created volume successfully. Apr 10 10:35:52 devstack sudo[85762]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-980fdab0-4d5d-4b31-969d-b83674bce32a tempest-VolumeQuotasAdminTestJSON-1733974360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a3c417df-6188-4656-81b5-08e79ee6c8d5" returned: 0 in 0.917s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-980fdab0-4d5d-4b31-969d-b83674bce32a tempest-VolumeQuotasAdminTestJSON-1733974360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a3c417df-6188-4656-81b5-08e79ee6c8d5 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:52 devstack sudo[85772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a3c417df-6188-4656-81b5-08e79ee6c8d5 Apr 10 10:35:52 devstack sudo[85772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:52 devstack sudo[85766]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a589cb17-2ca3-45ed-af5c-1687ce29aa13 tempest-VolumesTransfersV355Test-2140444755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.716s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:52 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-a589cb17-2ca3-45ed-af5c-1687ce29aa13 tempest-VolumesTransfersV355Test-2140444755 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:52 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-a589cb17-2ca3-45ed-af5c-1687ce29aa13 tempest-VolumesTransfersV355Test-2140444755 None] Deleted volume successfully. Apr 10 10:35:52 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a589cb17-2ca3-45ed-af5c-1687ce29aa13 tempest-VolumesTransfersV355Test-2140444755 None] Lock "cinder-8eb5801a-4b97-4628-a7f2-2985f0eaddc0-delete_volume" released by "delete_volume" :: held 2.606s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-50a1217a-09eb-4c7f-8a8c-b9fb72f66fab tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-50a1217a-09eb-4c7f-8a8c-b9fb72f66fab tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:52 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-50a1217a-09eb-4c7f-8a8c-b9fb72f66fab tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Creating offline snapshot f113c8c6-1c2f-4b9c-a6ca-1e4c83b719ca of volume b18df322-7c48-43b3-b988-e6813dd49c15 {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:35:52 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b0c2c8-e217-45b4-a1e3-81a529972cab]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-50a1217a-09eb-4c7f-8a8c-b9fb72f66fab tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:52 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:52 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] Flow 'volume_create_manager' (eda06f24-026c-43b2-8cf1-b5d02b91d76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:52 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d7a534-bd33-4259-b5d5-4c6df3f98a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:52 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d7a534-bd33-4259-b5d5-4c6df3f98a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1595804170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f49499ce-67f8-4d47-b296-f3dcaba69bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5daac84d61b4f7cbf0c3d4da741846d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:52Z,use_quota=True,user_id='a5ea3530a19247e48a31270ab40e7d77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:52 devstack sudo[85774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15 Apr 10 10:35:52 devstack sudo[85774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:52 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b7ea012-0b2d-4822-83b4-c605a940ab3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:52 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b7ea012-0b2d-4822-83b4-c605a940ab3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:52 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce8dc33-5bc0-42c3-a7a7-ceab4a9c9330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:52 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce8dc33-5bc0-42c3-a7a7-ceab4a9c9330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f49499ce-67f8-4d47-b296-f3dcaba69bae', 'volume_name': 'volume-f49499ce-67f8-4d47-b296-f3dcaba69bae', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:52 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae99b40-ac1e-40cd-9a87-fb655a235f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:52 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae99b40-ac1e-40cd-9a87-fb655a235f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:52 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b02fa6-c538-42a7-b27b-4e21599b4e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:52 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] Volume f49499ce-67f8-4d47-b296-f3dcaba69bae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f49499ce-67f8-4d47-b296-f3dcaba69bae', 'volume_size': 1} Apr 10 10:35:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:52 devstack sudo[85772]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-980fdab0-4d5d-4b31-969d-b83674bce32a tempest-VolumeQuotasAdminTestJSON-1733974360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a3c417df-6188-4656-81b5-08e79ee6c8d5" returned: 0 in 0.673s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:52 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-980fdab0-4d5d-4b31-969d-b83674bce32a tempest-VolumeQuotasAdminTestJSON-1733974360 None] Lock "cinder-quobyte-a3c417df-6188-4656-81b5-08e79ee6c8d5" released by "delete_volume" :: held 1.614s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:52 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-980fdab0-4d5d-4b31-969d-b83674bce32a tempest-VolumeQuotasAdminTestJSON-1733974360 None] Created reservations ['2b92ab27-c5fb-447e-828b-963aef4f1d81', '719d42b4-540e-418d-9e68-2ea9c9830e98', '15ab088c-3e4f-46a5-b603-ae9804abb0ca', 'b7554276-1169-4079-8c4a-606eaaf449c3'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-980fdab0-4d5d-4b31-969d-b83674bce32a tempest-VolumeQuotasAdminTestJSON-1733974360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-980fdab0-4d5d-4b31-969d-b83674bce32a tempest-VolumeQuotasAdminTestJSON-1733974360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:52 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-980fdab0-4d5d-4b31-969d-b83674bce32a tempest-VolumeQuotasAdminTestJSON-1733974360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:52 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-980fdab0-4d5d-4b31-969d-b83674bce32a tempest-VolumeQuotasAdminTestJSON-1733974360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-980fdab0-4d5d-4b31-969d-b83674bce32a tempest-VolumeQuotasAdminTestJSON-1733974360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-980fdab0-4d5d-4b31-969d-b83674bce32a tempest-VolumeQuotasAdminTestJSON-1733974360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:52 devstack sudo[85777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:35:52 devstack sudo[85777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:53 devstack sudo[85774]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-50a1217a-09eb-4c7f-8a8c-b9fb72f66fab tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15" returned: 0 in 0.653s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-50a1217a-09eb-4c7f-8a8c-b9fb72f66fab tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15.f113c8c6-1c2f-4b9c-a6ca-1e4c83b719ca 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:53 devstack sudo[85782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15.f113c8c6-1c2f-4b9c-a6ca-1e4c83b719ca 1G Apr 10 10:35:53 devstack sudo[85782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:53 devstack sudo[85777]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-980fdab0-4d5d-4b31-969d-b83674bce32a tempest-VolumeQuotasAdminTestJSON-1733974360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.853s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:53 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-980fdab0-4d5d-4b31-969d-b83674bce32a tempest-VolumeQuotasAdminTestJSON-1733974360 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:53 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-980fdab0-4d5d-4b31-969d-b83674bce32a tempest-VolumeQuotasAdminTestJSON-1733974360 None] Deleted volume successfully. Apr 10 10:35:53 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-980fdab0-4d5d-4b31-969d-b83674bce32a tempest-VolumeQuotasAdminTestJSON-1733974360 None] Lock "cinder-a3c417df-6188-4656-81b5-08e79ee6c8d5-delete_volume" released by "delete_volume" :: held 2.695s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:53 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:53 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] Flow 'volume_create_manager' (7371d935-4f1f-44b5-8e99-9116400504a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:53 devstack sudo[85782]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:53 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f1bb8ce-104c-4bf3-9856-5c7cb7488f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-50a1217a-09eb-4c7f-8a8c-b9fb72f66fab tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15.f113c8c6-1c2f-4b9c-a6ca-1e4c83b719ca 1G" returned: 0 in 0.859s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-50a1217a-09eb-4c7f-8a8c-b9fb72f66fab tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b18df322-7c48-43b3-b988-e6813dd49c15 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15.f113c8c6-1c2f-4b9c-a6ca-1e4c83b719ca {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:54 devstack sudo[85788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b18df322-7c48-43b3-b988-e6813dd49c15 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15.f113c8c6-1c2f-4b9c-a6ca-1e4c83b719ca Apr 10 10:35:54 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f1bb8ce-104c-4bf3-9856-5c7cb7488f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1674225355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d73b9e2-ca6e-45c2-a95b-0fca084c82b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e18b57325a7a465eb96c55a52c0931aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:54Z,use_quota=True,user_id='bf7680f7a6314bc380bd3c6198b578cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:54 devstack sudo[85788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:54 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e43d086b-506f-49f1-ba88-27bdb3e0c3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:54 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e43d086b-506f-49f1-ba88-27bdb3e0c3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:54 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e753963-ad45-4816-92ab-851fb1f454bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:54 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e753963-ad45-4816-92ab-851fb1f454bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d73b9e2-ca6e-45c2-a95b-0fca084c82b4', 'volume_name': 'volume-8d73b9e2-ca6e-45c2-a95b-0fca084c82b4', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:54 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ec1593a-b633-4591-aef8-1f3c7a1de60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:54 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ec1593a-b633-4591-aef8-1f3c7a1de60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:54 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6f1058-1d9d-42e8-9747-b66ce751bd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:54 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] Volume 8d73b9e2-ca6e-45c2-a95b-0fca084c82b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d73b9e2-ca6e-45c2-a95b-0fca084c82b4', 'volume_size': 1} Apr 10 10:35:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:54 devstack sudo[85788]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-50a1217a-09eb-4c7f-8a8c-b9fb72f66fab tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b18df322-7c48-43b3-b988-e6813dd49c15 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15.f113c8c6-1c2f-4b9c-a6ca-1e4c83b719ca" returned: 0 in 0.602s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:54 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-50a1217a-09eb-4c7f-8a8c-b9fb72f66fab tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15.f113c8c6-1c2f-4b9c-a6ca-1e4c83b719ca is being set with open permissions: ugo+rw Apr 10 10:35:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-50a1217a-09eb-4c7f-8a8c-b9fb72f66fab tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15.f113c8c6-1c2f-4b9c-a6ca-1e4c83b719ca {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:54 devstack sudo[85793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15.f113c8c6-1c2f-4b9c-a6ca-1e4c83b719ca Apr 10 10:35:54 devstack sudo[85793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:55 devstack sudo[85793]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-50a1217a-09eb-4c7f-8a8c-b9fb72f66fab tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15.f113c8c6-1c2f-4b9c-a6ca-1e4c83b719ca" returned: 0 in 0.542s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-50a1217a-09eb-4c7f-8a8c-b9fb72f66fab tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:55 devstack sudo[85796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15.info Apr 10 10:35:55 devstack sudo[85796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:55 devstack sudo[85796]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-50a1217a-09eb-4c7f-8a8c-b9fb72f66fab tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15.info" returned: 0 in 0.490s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:55 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-50a1217a-09eb-4c7f-8a8c-b9fb72f66fab tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15.info is being set with open permissions: ugo+rw Apr 10 10:35:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-50a1217a-09eb-4c7f-8a8c-b9fb72f66fab tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:55 devstack sudo[85799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15.info Apr 10 10:35:55 devstack sudo[85799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:56 devstack sudo[85799]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-50a1217a-09eb-4c7f-8a8c-b9fb72f66fab tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15.info" returned: 0 in 0.514s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-50a1217a-09eb-4c7f-8a8c-b9fb72f66fab tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.749s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.591s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:56 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1595804170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f49499ce-67f8-4d47-b296-f3dcaba69bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5daac84d61b4f7cbf0c3d4da741846d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:52Z,use_quota=True,user_id='a5ea3530a19247e48a31270ab40e7d77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:56 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] Creating volume f49499ce-67f8-4d47-b296-f3dcaba69bae {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:56 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:56 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:56 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:56 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:35:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f49499ce-67f8-4d47-b296-f3dcaba69bae 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:56 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-50a1217a-09eb-4c7f-8a8c-b9fb72f66fab tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Create snapshot completed successfully Apr 10 10:35:56 devstack sudo[85802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f49499ce-67f8-4d47-b296-f3dcaba69bae 1073741824 Apr 10 10:35:56 devstack sudo[85802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:56 devstack sudo[85802]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f49499ce-67f8-4d47-b296-f3dcaba69bae 1073741824" returned: 0 in 0.776s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f49499ce-67f8-4d47-b296-f3dcaba69bae {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:57 devstack sudo[85841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f49499ce-67f8-4d47-b296-f3dcaba69bae Apr 10 10:35:57 devstack sudo[85841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-5b54d685-4798-422b-a59b-3965443d5527 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Acquiring lock "cinder-f113c8c6-1c2f-4b9c-a6ca-1e4c83b719ca-delete_snapshot" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-5b54d685-4798-422b-a59b-3965443d5527 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Lock "cinder-f113c8c6-1c2f-4b9c-a6ca-1e4c83b719ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-5b54d685-4798-422b-a59b-3965443d5527 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Acquiring lock "cinder-quobyte-b18df322-7c48-43b3-b988-e6813dd49c15" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-5b54d685-4798-422b-a59b-3965443d5527 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Lock "cinder-quobyte-b18df322-7c48-43b3-b988-e6813dd49c15" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-5b54d685-4798-422b-a59b-3965443d5527 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Acquiring lock "cinder-quobyte-f113c8c6-1c2f-4b9c-a6ca-1e4c83b719ca" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-5b54d685-4798-422b-a59b-3965443d5527 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Lock "cinder-quobyte-f113c8c6-1c2f-4b9c-a6ca-1e4c83b719ca" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-5b54d685-4798-422b-a59b-3965443d5527 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Deleting offline snapshot f113c8c6-1c2f-4b9c-a6ca-1e4c83b719ca of volume b18df322-7c48-43b3-b988-e6813dd49c15 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-5b54d685-4798-422b-a59b-3965443d5527 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] snapshot_file for this snap is: volume-b18df322-7c48-43b3-b988-e6813dd49c15.f113c8c6-1c2f-4b9c-a6ca-1e4c83b719ca {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f22689-247d-447c-8cda-6abf969dbd14]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5b54d685-4798-422b-a59b-3965443d5527 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15.f113c8c6-1c2f-4b9c-a6ca-1e4c83b719ca {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:57 devstack sudo[85843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15.f113c8c6-1c2f-4b9c-a6ca-1e4c83b719ca Apr 10 10:35:57 devstack sudo[85843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:57 devstack sudo[85841]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f49499ce-67f8-4d47-b296-f3dcaba69bae" returned: 0 in 0.560s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.519s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1674225355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d73b9e2-ca6e-45c2-a95b-0fca084c82b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e18b57325a7a465eb96c55a52c0931aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:54Z,use_quota=True,user_id='bf7680f7a6314bc380bd3c6198b578cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] Creating volume 8d73b9e2-ca6e-45c2-a95b-0fca084c82b4 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:57 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8d73b9e2-ca6e-45c2-a95b-0fca084c82b4 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b02fa6-c538-42a7-b27b-4e21599b4e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f49499ce-67f8-4d47-b296-f3dcaba69bae', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6d75f67-2ab5-4873-85dc-3b86353ee167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:57 devstack sudo[85846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8d73b9e2-ca6e-45c2-a95b-0fca084c82b4 1073741824 Apr 10 10:35:57 devstack sudo[85846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:57 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] Volume volume-f49499ce-67f8-4d47-b296-f3dcaba69bae (f49499ce-67f8-4d47-b296-f3dcaba69bae): created successfully Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6d75f67-2ab5-4873-85dc-3b86353ee167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] Flow 'volume_create_manager' (eda06f24-026c-43b2-8cf1-b5d02b91d76a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:57 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-d3581b31-e1c3-4d11-9b7e-a1b5f750bc79 tempest-VolumesTransfersV355Test-2065874467 None] Created volume successfully. Apr 10 10:35:57 devstack sudo[85843]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5b54d685-4798-422b-a59b-3965443d5527 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15.f113c8c6-1c2f-4b9c-a6ca-1e4c83b719ca" returned: 0 in 0.578s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-5b54d685-4798-422b-a59b-3965443d5527 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b18df322-7c48-43b3-b988-e6813dd49c15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[6871057f-1cbf-4929-8ae8-da06b0e0c037]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5b54d685-4798-422b-a59b-3965443d5527 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:57 devstack sudo[85851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15 Apr 10 10:35:57 devstack sudo[85851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:58 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-bc2afbcb-02a7-47d1-b118-8f5ba69ab117 tempest-VolumesTransfersV355Test-2140444755 None] Acquiring lock "cinder-f49499ce-67f8-4d47-b296-f3dcaba69bae-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:58 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-bc2afbcb-02a7-47d1-b118-8f5ba69ab117 tempest-VolumesTransfersV355Test-2140444755 None] Lock "cinder-f49499ce-67f8-4d47-b296-f3dcaba69bae-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:58 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-bc2afbcb-02a7-47d1-b118-8f5ba69ab117 tempest-VolumesTransfersV355Test-2140444755 None] Acquiring lock "cinder-quobyte-f49499ce-67f8-4d47-b296-f3dcaba69bae" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:58 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-bc2afbcb-02a7-47d1-b118-8f5ba69ab117 tempest-VolumesTransfersV355Test-2140444755 None] Lock "cinder-quobyte-f49499ce-67f8-4d47-b296-f3dcaba69bae" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:58 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78e5245-49a5-4ca5-b4a3-4d1af5b3d4fa]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bc2afbcb-02a7-47d1-b118-8f5ba69ab117 tempest-VolumesTransfersV355Test-2140444755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f49499ce-67f8-4d47-b296-f3dcaba69bae {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:58 devstack sudo[85846]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8d73b9e2-ca6e-45c2-a95b-0fca084c82b4 1073741824" returned: 0 in 0.866s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:58 devstack sudo[85856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f49499ce-67f8-4d47-b296-f3dcaba69bae Apr 10 10:35:58 devstack sudo[85856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8d73b9e2-ca6e-45c2-a95b-0fca084c82b4 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:58 devstack sudo[85861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8d73b9e2-ca6e-45c2-a95b-0fca084c82b4 Apr 10 10:35:58 devstack sudo[85861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:58 devstack sudo[85851]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5b54d685-4798-422b-a59b-3965443d5527 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15" returned: 0 in 0.729s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5b54d685-4798-422b-a59b-3965443d5527 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15.f113c8c6-1c2f-4b9c-a6ca-1e4c83b719ca {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:58 devstack sudo[85863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15.f113c8c6-1c2f-4b9c-a6ca-1e4c83b719ca Apr 10 10:35:58 devstack sudo[85863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:58 devstack sudo[85861]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8d73b9e2-ca6e-45c2-a95b-0fca084c82b4" returned: 0 in 0.486s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:58 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6f1058-1d9d-42e8-9747-b66ce751bd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d73b9e2-ca6e-45c2-a95b-0fca084c82b4', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a106c16-c107-4b34-b662-9adacf2b204c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:59 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] Volume volume-8d73b9e2-ca6e-45c2-a95b-0fca084c82b4 (8d73b9e2-ca6e-45c2-a95b-0fca084c82b4): created successfully Apr 10 10:35:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a106c16-c107-4b34-b662-9adacf2b204c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] Flow 'volume_create_manager' (7371d935-4f1f-44b5-8e99-9116400504a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:59 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-1de2a05a-f0a6-452f-b759-b5158c90ca81 tempest-VolumeQuotasAdminTestJSON-1733974360 None] Created volume successfully. Apr 10 10:35:59 devstack sudo[85856]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bc2afbcb-02a7-47d1-b118-8f5ba69ab117 tempest-VolumesTransfersV355Test-2140444755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f49499ce-67f8-4d47-b296-f3dcaba69bae" returned: 0 in 0.674s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bc2afbcb-02a7-47d1-b118-8f5ba69ab117 tempest-VolumesTransfersV355Test-2140444755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f49499ce-67f8-4d47-b296-f3dcaba69bae {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:59 devstack sudo[85872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f49499ce-67f8-4d47-b296-f3dcaba69bae Apr 10 10:35:59 devstack sudo[85872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:59 devstack sudo[85863]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5b54d685-4798-422b-a59b-3965443d5527 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15.f113c8c6-1c2f-4b9c-a6ca-1e4c83b719ca" returned: 0 in 0.613s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5b54d685-4798-422b-a59b-3965443d5527 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15.f113c8c6-1c2f-4b9c-a6ca-1e4c83b719ca {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:59 devstack sudo[85874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15.f113c8c6-1c2f-4b9c-a6ca-1e4c83b719ca Apr 10 10:35:59 devstack sudo[85874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:59 devstack sudo[85872]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:59 devstack sudo[85874]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bc2afbcb-02a7-47d1-b118-8f5ba69ab117 tempest-VolumesTransfersV355Test-2140444755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f49499ce-67f8-4d47-b296-f3dcaba69bae" returned: 0 in 0.641s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:59 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-bc2afbcb-02a7-47d1-b118-8f5ba69ab117 tempest-VolumesTransfersV355Test-2140444755 None] Lock "cinder-quobyte-f49499ce-67f8-4d47-b296-f3dcaba69bae" released by "delete_volume" :: held 1.361s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5b54d685-4798-422b-a59b-3965443d5527 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15.f113c8c6-1c2f-4b9c-a6ca-1e4c83b719ca" returned: 0 in 0.571s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:59 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-5b54d685-4798-422b-a59b-3965443d5527 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Lock "cinder-quobyte-f113c8c6-1c2f-4b9c-a6ca-1e4c83b719ca" released by "_delete_snapshot" :: held 2.569s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:59 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-5b54d685-4798-422b-a59b-3965443d5527 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Lock "cinder-quobyte-b18df322-7c48-43b3-b988-e6813dd49c15" released by "delete_snapshot" :: held 2.594s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:59 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-5b54d685-4798-422b-a59b-3965443d5527 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Created reservations ['2bbc35ff-536e-4050-8c29-8220a5ff924d', '17691ba4-1dac-4899-9c0c-d436fb05e910', '551492bd-9841-4243-ae17-dc9800222ed2', 'b9b12ff8-13c1-4a51-96bb-d1ed63934af4'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:59 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-bc2afbcb-02a7-47d1-b118-8f5ba69ab117 tempest-VolumesTransfersV355Test-2140444755 None] Created reservations ['4d2cf50a-9c0e-47f5-8d83-9c0abdc181fb', 'f90431f2-9b2d-4e44-8aab-dab40d603091', '52dce642-2e65-49b2-a39e-e0fa9437a61f', 'bd499ad8-cc2f-4cf2-97d4-3f805beccc0f'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:59 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-5b54d685-4798-422b-a59b-3965443d5527 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Delete snapshot completed successfully. Apr 10 10:35:59 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-5b54d685-4798-422b-a59b-3965443d5527 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Lock "cinder-f113c8c6-1c2f-4b9c-a6ca-1e4c83b719ca-delete_snapshot" released by "delete_snapshot" :: held 2.761s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-bc2afbcb-02a7-47d1-b118-8f5ba69ab117 tempest-VolumesTransfersV355Test-2140444755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-bc2afbcb-02a7-47d1-b118-8f5ba69ab117 tempest-VolumesTransfersV355Test-2140444755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:59 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-bc2afbcb-02a7-47d1-b118-8f5ba69ab117 tempest-VolumesTransfersV355Test-2140444755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:59 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-bc2afbcb-02a7-47d1-b118-8f5ba69ab117 tempest-VolumesTransfersV355Test-2140444755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-bc2afbcb-02a7-47d1-b118-8f5ba69ab117 tempest-VolumesTransfersV355Test-2140444755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bc2afbcb-02a7-47d1-b118-8f5ba69ab117 tempest-VolumesTransfersV355Test-2140444755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:00 devstack sudo[85879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:36:00 devstack sudo[85879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:00 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-92ce9686-44b9-479b-843d-5848ab930248 tempest-VolumeQuotasAdminTestJSON-1605431404 None] Transfer volume completed successfully. Apr 10 10:36:00 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-49f10434-bcde-4f37-b706-5dd1d09eeae1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Acquiring lock "cinder-b18df322-7c48-43b3-b988-e6813dd49c15-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:00 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-49f10434-bcde-4f37-b706-5dd1d09eeae1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Lock "cinder-b18df322-7c48-43b3-b988-e6813dd49c15-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:00 devstack sudo[85879]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bc2afbcb-02a7-47d1-b118-8f5ba69ab117 tempest-VolumesTransfersV355Test-2140444755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.588s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:00 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-bc2afbcb-02a7-47d1-b118-8f5ba69ab117 tempest-VolumesTransfersV355Test-2140444755 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:00 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-bc2afbcb-02a7-47d1-b118-8f5ba69ab117 tempest-VolumesTransfersV355Test-2140444755 None] Deleted volume successfully. Apr 10 10:36:00 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-49f10434-bcde-4f37-b706-5dd1d09eeae1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Acquiring lock "cinder-quobyte-b18df322-7c48-43b3-b988-e6813dd49c15" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:00 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-bc2afbcb-02a7-47d1-b118-8f5ba69ab117 tempest-VolumesTransfersV355Test-2140444755 None] Lock "cinder-f49499ce-67f8-4d47-b296-f3dcaba69bae-delete_volume" released by "delete_volume" :: held 2.410s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:00 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-49f10434-bcde-4f37-b706-5dd1d09eeae1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Lock "cinder-quobyte-b18df322-7c48-43b3-b988-e6813dd49c15" acquired by "delete_volume" :: waited 0.014s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:00 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafbebc7-e02b-472d-81bd-8fc4f70762ea]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-49f10434-bcde-4f37-b706-5dd1d09eeae1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:00 devstack sudo[85882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15 Apr 10 10:36:00 devstack sudo[85882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:01 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a284c9cf-410f-4bbd-8aef-15ecb23bb1f6 tempest-VolumeQuotasAdminTestJSON-1902272938 None] Acquiring lock "cinder-8d73b9e2-ca6e-45c2-a95b-0fca084c82b4-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:01 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a284c9cf-410f-4bbd-8aef-15ecb23bb1f6 tempest-VolumeQuotasAdminTestJSON-1902272938 None] Lock "cinder-8d73b9e2-ca6e-45c2-a95b-0fca084c82b4-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:01 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a284c9cf-410f-4bbd-8aef-15ecb23bb1f6 tempest-VolumeQuotasAdminTestJSON-1902272938 None] Acquiring lock "cinder-quobyte-8d73b9e2-ca6e-45c2-a95b-0fca084c82b4" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:01 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a284c9cf-410f-4bbd-8aef-15ecb23bb1f6 tempest-VolumeQuotasAdminTestJSON-1902272938 None] Lock "cinder-quobyte-8d73b9e2-ca6e-45c2-a95b-0fca084c82b4" acquired by "delete_volume" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:01 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84b9f78-b3d9-4364-8358-7bcca30bd331]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a284c9cf-410f-4bbd-8aef-15ecb23bb1f6 tempest-VolumeQuotasAdminTestJSON-1902272938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8d73b9e2-ca6e-45c2-a95b-0fca084c82b4 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:01 devstack sudo[85884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8d73b9e2-ca6e-45c2-a95b-0fca084c82b4 Apr 10 10:36:01 devstack sudo[85884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:01 devstack sudo[85882]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-49f10434-bcde-4f37-b706-5dd1d09eeae1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15" returned: 0 in 0.818s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-49f10434-bcde-4f37-b706-5dd1d09eeae1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:01 devstack sudo[85889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15 Apr 10 10:36:01 devstack sudo[85889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:01 devstack sudo[85884]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a284c9cf-410f-4bbd-8aef-15ecb23bb1f6 tempest-VolumeQuotasAdminTestJSON-1902272938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8d73b9e2-ca6e-45c2-a95b-0fca084c82b4" returned: 0 in 0.682s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a284c9cf-410f-4bbd-8aef-15ecb23bb1f6 tempest-VolumeQuotasAdminTestJSON-1902272938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8d73b9e2-ca6e-45c2-a95b-0fca084c82b4 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:01 devstack sudo[85894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8d73b9e2-ca6e-45c2-a95b-0fca084c82b4 Apr 10 10:36:01 devstack sudo[85894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:02 devstack sudo[85889]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-49f10434-bcde-4f37-b706-5dd1d09eeae1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b18df322-7c48-43b3-b988-e6813dd49c15" returned: 0 in 0.776s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:02 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-49f10434-bcde-4f37-b706-5dd1d09eeae1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Lock "cinder-quobyte-b18df322-7c48-43b3-b988-e6813dd49c15" released by "delete_volume" :: held 1.654s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:02 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-49f10434-bcde-4f37-b706-5dd1d09eeae1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Created reservations ['edb94d0c-a311-490e-929f-ae05358f1e25', 'c48dff6f-55e6-4a4c-a770-1e99ef8d9b17', '03a007f1-c781-4104-9daf-e9feac5b2464', '6f119df0-117e-4e97-8546-bd1353fe161e'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:02 devstack sudo[85894]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a284c9cf-410f-4bbd-8aef-15ecb23bb1f6 tempest-VolumeQuotasAdminTestJSON-1902272938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-8d73b9e2-ca6e-45c2-a95b-0fca084c82b4" returned: 0 in 0.622s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:02 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a284c9cf-410f-4bbd-8aef-15ecb23bb1f6 tempest-VolumeQuotasAdminTestJSON-1902272938 None] Lock "cinder-quobyte-8d73b9e2-ca6e-45c2-a95b-0fca084c82b4" released by "delete_volume" :: held 1.344s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-49f10434-bcde-4f37-b706-5dd1d09eeae1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-49f10434-bcde-4f37-b706-5dd1d09eeae1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:02 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-49f10434-bcde-4f37-b706-5dd1d09eeae1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:02 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-49f10434-bcde-4f37-b706-5dd1d09eeae1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-49f10434-bcde-4f37-b706-5dd1d09eeae1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-49f10434-bcde-4f37-b706-5dd1d09eeae1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:02 devstack sudo[85898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:36:02 devstack sudo[85898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:02 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-a284c9cf-410f-4bbd-8aef-15ecb23bb1f6 tempest-VolumeQuotasAdminTestJSON-1902272938 None] Created reservations ['8e8ce1da-6777-4985-805b-19af746a0fa9', '9f7b3ede-476d-4d30-8dde-a412be80646c', '0ac02c6b-8224-45b5-8443-b6059afe0892', 'f96ac238-db9d-4cb3-9abd-9bd15c98af99'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a284c9cf-410f-4bbd-8aef-15ecb23bb1f6 tempest-VolumeQuotasAdminTestJSON-1902272938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a284c9cf-410f-4bbd-8aef-15ecb23bb1f6 tempest-VolumeQuotasAdminTestJSON-1902272938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:02 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a284c9cf-410f-4bbd-8aef-15ecb23bb1f6 tempest-VolumeQuotasAdminTestJSON-1902272938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:02 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a284c9cf-410f-4bbd-8aef-15ecb23bb1f6 tempest-VolumeQuotasAdminTestJSON-1902272938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a284c9cf-410f-4bbd-8aef-15ecb23bb1f6 tempest-VolumeQuotasAdminTestJSON-1902272938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a284c9cf-410f-4bbd-8aef-15ecb23bb1f6 tempest-VolumeQuotasAdminTestJSON-1902272938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:02 devstack sudo[85900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:36:02 devstack sudo[85900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:03 devstack sudo[85898]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-49f10434-bcde-4f37-b706-5dd1d09eeae1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.828s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:03 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-49f10434-bcde-4f37-b706-5dd1d09eeae1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:03 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-49f10434-bcde-4f37-b706-5dd1d09eeae1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Deleted volume successfully. Apr 10 10:36:03 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-49f10434-bcde-4f37-b706-5dd1d09eeae1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1362034657 None] Lock "cinder-b18df322-7c48-43b3-b988-e6813dd49c15-delete_volume" released by "delete_volume" :: held 2.773s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:03 devstack sudo[85900]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a284c9cf-410f-4bbd-8aef-15ecb23bb1f6 tempest-VolumeQuotasAdminTestJSON-1902272938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.793s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:03 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-a284c9cf-410f-4bbd-8aef-15ecb23bb1f6 tempest-VolumeQuotasAdminTestJSON-1902272938 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:03 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-a284c9cf-410f-4bbd-8aef-15ecb23bb1f6 tempest-VolumeQuotasAdminTestJSON-1902272938 None] Deleted volume successfully. Apr 10 10:36:03 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a284c9cf-410f-4bbd-8aef-15ecb23bb1f6 tempest-VolumeQuotasAdminTestJSON-1902272938 None] Lock "cinder-8d73b9e2-ca6e-45c2-a95b-0fca084c82b4-delete_volume" released by "delete_volume" :: held 2.356s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:07 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] Flow 'volume_create_manager' (a915d451-e3a6-4777-a740-13026ec56f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e209d6cd-079d-442d-bc93-0519d82c51a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e209d6cd-079d-442d-bc93-0519d82c51a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1125854708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c61645f-cc48-4395-8da2-777288589943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18d842e2766441ae9680d22535b69843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:07Z,use_quota=True,user_id='af5425dfdc6849beb0f31385c8e34df5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d3d48f-c1c3-4cda-bd09-d38d3e972fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d3d48f-c1c3-4cda-bd09-d38d3e972fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58100be3-bc24-4faf-82f9-52fc1a4458d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58100be3-bc24-4faf-82f9-52fc1a4458d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c61645f-cc48-4395-8da2-777288589943', 'volume_name': 'volume-6c61645f-cc48-4395-8da2-777288589943', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aec9773-05e8-4caf-98f2-eaff480aca53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aec9773-05e8-4caf-98f2-eaff480aca53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1eb8bf0-f28f-47e7-88b3-a4b40eb1c27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:07 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] Volume 6c61645f-cc48-4395-8da2-777288589943: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c61645f-cc48-4395-8da2-777288589943', 'volume_size': 1} Apr 10 10:36:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1125854708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c61645f-cc48-4395-8da2-777288589943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18d842e2766441ae9680d22535b69843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:07Z,use_quota=True,user_id='af5425dfdc6849beb0f31385c8e34df5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] Creating volume 6c61645f-cc48-4395-8da2-777288589943 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:07 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:36:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:07 devstack sudo[85905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943 1073741824 Apr 10 10:36:07 devstack sudo[85905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:08 devstack sudo[85905]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943 1073741824" returned: 0 in 0.611s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:08 devstack sudo[85910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943 Apr 10 10:36:08 devstack sudo[85910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:08 devstack sudo[85910]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943" returned: 0 in 0.466s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:08 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:08 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1eb8bf0-f28f-47e7-88b3-a4b40eb1c27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c61645f-cc48-4395-8da2-777288589943', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:08 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f26e00-c4da-4ef3-b83c-3dfe66dae75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:08 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] Volume volume-6c61645f-cc48-4395-8da2-777288589943 (6c61645f-cc48-4395-8da2-777288589943): created successfully Apr 10 10:36:08 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f26e00-c4da-4ef3-b83c-3dfe66dae75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:08 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] Flow 'volume_create_manager' (a915d451-e3a6-4777-a740-13026ec56f53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:08 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-176b676e-2a6b-4117-b619-45aaaf8188a4 tempest-VolumesCloneTest-842889893 None] Created volume successfully. Apr 10 10:36:09 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Flow 'volume_create_manager' (30eb3079-93bd-46b4-b0b9-4ef63a7c4e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e050e1cf-b496-476a-8fe8-72b632455f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e050e1cf-b496-476a-8fe8-72b632455f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1366936615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b88f968d-f85c-4257-98f1-000c763bb4fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18d842e2766441ae9680d22535b69843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=6c61645f-cc48-4395-8da2-777288589943,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:10Z,use_quota=True,user_id='af5425dfdc6849beb0f31385c8e34df5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16d06444-89af-4c75-aaef-08735ef9920c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16d06444-89af-4c75-aaef-08735ef9920c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc9ade91-83cd-46ac-9ad6-0ab2a7e78ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc9ade91-83cd-46ac-9ad6-0ab2a7e78ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b88f968d-f85c-4257-98f1-000c763bb4fd', 'volume_name': 'volume-b88f968d-f85c-4257-98f1-000c763bb4fd', 'volume_size': 2, 'source_volid': '6c61645f-cc48-4395-8da2-777288589943', 'source_volstatus': 'available'}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7803d4cf-3c05-44df-8a1f-d034a7a7284a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7803d4cf-3c05-44df-8a1f-d034a7a7284a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be482aa-e776-49c8-a792-5bb65cb53d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:09 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Volume b88f968d-f85c-4257-98f1-000c763bb4fd: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b88f968d-f85c-4257-98f1-000c763bb4fd', 'volume_size': 2, 'source_volid': '6c61645f-cc48-4395-8da2-777288589943', 'source_volstatus': 'available'} Apr 10 10:36:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:09 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Cloning volume 6c61645f-cc48-4395-8da2-777288589943 to volume b88f968d-f85c-4257-98f1-000c763bb4fd Apr 10 10:36:10 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Creating offline snapshot 22f8d393-7149-4b66-9d7e-3db06b35e6fb of volume 6c61645f-cc48-4395-8da2-777288589943 {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:36:10 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce09a37d-06b5-4d23-a613-bfac08b6fdee]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:10 devstack sudo[85914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943 Apr 10 10:36:10 devstack sudo[85914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:10 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] Flow 'volume_create_manager' (0b464b15-4b1a-442b-9718-b352a3074064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4027d72a-931a-4742-8bfc-40b15bf0cb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4027d72a-931a-4742-8bfc-40b15bf0cb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1835962688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e82098b2-795e-406b-ad94-e210aa234e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a794ff33593e40b281c82a8b3b88a168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:10Z,use_quota=True,user_id='e214fb74808f4b5badd10d345dcd4c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c61441b6-2ef3-49c6-9e08-d8ab53a20e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c61441b6-2ef3-49c6-9e08-d8ab53a20e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b1f9301-5414-499f-a0a8-82749b73bf85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b1f9301-5414-499f-a0a8-82749b73bf85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e82098b2-795e-406b-ad94-e210aa234e18', 'volume_name': 'volume-e82098b2-795e-406b-ad94-e210aa234e18', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (906cab28-8c5d-40d2-a71d-1d3301d23715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (906cab28-8c5d-40d2-a71d-1d3301d23715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c97d13a8-163a-4d07-845b-9ee2e3158afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:10 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] Volume e82098b2-795e-406b-ad94-e210aa234e18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e82098b2-795e-406b-ad94-e210aa234e18', 'volume_size': 1} Apr 10 10:36:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:10 devstack sudo[85914]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943" returned: 0 in 0.690s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943.22f8d393-7149-4b66-9d7e-3db06b35e6fb 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:10 devstack sudo[85919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943.22f8d393-7149-4b66-9d7e-3db06b35e6fb 1G Apr 10 10:36:10 devstack sudo[85919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:11 devstack sudo[85919]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943.22f8d393-7149-4b66-9d7e-3db06b35e6fb 1G" returned: 0 in 0.651s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c61645f-cc48-4395-8da2-777288589943 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943.22f8d393-7149-4b66-9d7e-3db06b35e6fb {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:11 devstack sudo[85924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c61645f-cc48-4395-8da2-777288589943 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943.22f8d393-7149-4b66-9d7e-3db06b35e6fb Apr 10 10:36:11 devstack sudo[85924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:12 devstack sudo[85924]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c61645f-cc48-4395-8da2-777288589943 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943.22f8d393-7149-4b66-9d7e-3db06b35e6fb" returned: 0 in 0.666s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:12 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943.22f8d393-7149-4b66-9d7e-3db06b35e6fb is being set with open permissions: ugo+rw Apr 10 10:36:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943.22f8d393-7149-4b66-9d7e-3db06b35e6fb {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:12 devstack sudo[85931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943.22f8d393-7149-4b66-9d7e-3db06b35e6fb Apr 10 10:36:12 devstack sudo[85931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:12 devstack sudo[85931]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943.22f8d393-7149-4b66-9d7e-3db06b35e6fb" returned: 0 in 0.544s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:12 devstack sudo[85935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943.info Apr 10 10:36:12 devstack sudo[85935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:13 devstack sudo[85935]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943.info" returned: 0 in 0.612s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:13 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943.info is being set with open permissions: ugo+rw Apr 10 10:36:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:13 devstack sudo[85940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943.info Apr 10 10:36:13 devstack sudo[85940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:13 devstack sudo[85940]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943.info" returned: 0 in 0.542s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:13 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Acquiring lock "cinder-quobyte-b88f968d-f85c-4257-98f1-000c763bb4fd" by "_copy_volume_from_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:13 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Lock "cinder-quobyte-b88f968d-f85c-4257-98f1-000c763bb4fd" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:13 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] snapshot: 22f8d393-7149-4b66-9d7e-3db06b35e6fb, volume: b88f968d-f85c-4257-98f1-000c763bb4fd, {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:36:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:13 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:13 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:13 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e70e192-03aa-47d3-a0f5-93b138c9b89b]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943.22f8d393-7149-4b66-9d7e-3db06b35e6fb {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:13 devstack sudo[85957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943.22f8d393-7149-4b66-9d7e-3db06b35e6fb Apr 10 10:36:13 devstack sudo[85957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:14 devstack sudo[85957]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943.22f8d393-7149-4b66-9d7e-3db06b35e6fb" returned: 0 in 0.543s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:14 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c61645f-cc48-4395-8da2-777288589943(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:36:14 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943 {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:36:14 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Creating direct copy from snapshot {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:36:14 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03e17b7-613c-48d9-aca0-c51d16e75cbb]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:14 devstack sudo[85962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943 Apr 10 10:36:14 devstack sudo[85962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:15 devstack sudo[85962]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943" returned: 0 in 0.712s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:15 devstack cinder-volume[81938]: DEBUG cinder.utils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Path /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b88f968d-f85c-4257-98f1-000c763bb4fd not found in is_blk_device check {{(pid=81938) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:36:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b88f968d-f85c-4257-98f1-000c763bb4fd {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:15 devstack sudo[85967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b88f968d-f85c-4257-98f1-000c763bb4fd Apr 10 10:36:15 devstack sudo[85967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:17 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writing DB stats cinder:UPDATE=205,cinder:DELETE=11,cinder:SELECT=158,cinder:INSERT=49 {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:36:17 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writing DB stats cinder:UPDATE=203,cinder:SELECT=144,cinder:INSERT=48,cinder:DELETE=19 {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:36:17 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:17 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] Flow 'volume_create_manager' (3dc8c8bb-d118-4196-b7f8-15b93d6a7265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:17 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e9d197-61bd-4db8-ab81-8735b4c78d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:17 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e9d197-61bd-4db8-ab81-8735b4c78d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1713632842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed1621c-7505-48f9-9f07-591fa799989d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac8dff469b3a4696854bd1315ae1726e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:18Z,use_quota=True,user_id='010c136674e949e9bbce61919300a3ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:17 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (049fc789-f2e4-4e5e-a9ae-4b114f1592c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:17 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (049fc789-f2e4-4e5e-a9ae-4b114f1592c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:17 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5de4bdb-a86c-4a35-a6f6-626bbd2c2058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:17 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5de4bdb-a86c-4a35-a6f6-626bbd2c2058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ed1621c-7505-48f9-9f07-591fa799989d', 'volume_name': 'volume-3ed1621c-7505-48f9-9f07-591fa799989d', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:17 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f523fc69-6220-4fe7-a6da-8b6c20775965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:17 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f523fc69-6220-4fe7-a6da-8b6c20775965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:17 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6643d9b1-6fd2-4566-bbc4-3a28838db161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:17 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] Volume 3ed1621c-7505-48f9-9f07-591fa799989d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ed1621c-7505-48f9-9f07-591fa799989d', 'volume_size': 1} Apr 10 10:36:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:17 devstack sudo[85967]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b88f968d-f85c-4257-98f1-000c763bb4fd" returned: 0 in 2.723s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:17 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b8efda-885c-484c-89d0-ce0b765b6f37]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:17 devstack sudo[85982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943 Apr 10 10:36:17 devstack sudo[85982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:18 devstack sudo[85982]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943" returned: 0 in 0.820s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:18 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943, size 1024.00 MB, duration 2.73 sec, destination /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b88f968d-f85c-4257-98f1-000c763bb4fd {{(pid=81938) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:36:18 devstack cinder-volume[81938]: INFO cinder.image.image_utils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Converted 1024.00 MB image at 375.75 MB/s Apr 10 10:36:18 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b88f968d-f85c-4257-98f1-000c763bb4fd is being set with open permissions: ugo+rw Apr 10 10:36:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b88f968d-f85c-4257-98f1-000c763bb4fd {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:18 devstack sudo[86012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b88f968d-f85c-4257-98f1-000c763bb4fd Apr 10 10:36:18 devstack sudo[86012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:19 devstack sudo[86012]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b88f968d-f85c-4257-98f1-000c763bb4fd" returned: 0 in 0.616s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:19 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Lock "cinder-quobyte-b88f968d-f85c-4257-98f1-000c763bb4fd" released by "_copy_volume_from_snapshot" :: held 5.481s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:19 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Acquiring lock "cinder-quobyte-22f8d393-7149-4b66-9d7e-3db06b35e6fb" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:19 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Lock "cinder-quobyte-22f8d393-7149-4b66-9d7e-3db06b35e6fb" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:19 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Deleting offline snapshot 22f8d393-7149-4b66-9d7e-3db06b35e6fb of volume 6c61645f-cc48-4395-8da2-777288589943 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:36:19 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] snapshot_file for this snap is: volume-6c61645f-cc48-4395-8da2-777288589943.22f8d393-7149-4b66-9d7e-3db06b35e6fb {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:36:19 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b5f8e0-2ae1-4958-a955-6e600aa4d266]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943.22f8d393-7149-4b66-9d7e-3db06b35e6fb {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:19 devstack sudo[86016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943.22f8d393-7149-4b66-9d7e-3db06b35e6fb Apr 10 10:36:19 devstack sudo[86016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:19 devstack sudo[86016]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943.22f8d393-7149-4b66-9d7e-3db06b35e6fb" returned: 0 in 0.517s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:19 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c61645f-cc48-4395-8da2-777288589943(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:36:19 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66f8d00-9d0e-465f-945c-2a2f25c45c7a]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:19 devstack sudo[86021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943 Apr 10 10:36:19 devstack sudo[86021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:20 devstack sudo[86021]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943" returned: 0 in 0.503s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943.22f8d393-7149-4b66-9d7e-3db06b35e6fb {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:20 devstack sudo[86027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943.22f8d393-7149-4b66-9d7e-3db06b35e6fb Apr 10 10:36:20 devstack sudo[86027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:20 devstack sudo[86027]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943.22f8d393-7149-4b66-9d7e-3db06b35e6fb" returned: 0 in 0.569s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943.22f8d393-7149-4b66-9d7e-3db06b35e6fb {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:20 devstack sudo[86032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943.22f8d393-7149-4b66-9d7e-3db06b35e6fb Apr 10 10:36:20 devstack sudo[86032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] Flow 'volume_create_manager' (7e958c50-be77-4e1d-b06c-500fd02bc487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ca561cd-08ee-4e08-a08f-67d256436053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ca561cd-08ee-4e08-a08f-67d256436053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-335453935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54fda538-00ea-4db8-a254-bb515c4d4174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bfccb1031b842f0904bddb7077a4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:21Z,use_quota=True,user_id='efb6a88085154bda891275dfe3fbdc74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba1b72c1-9997-4b27-a202-d5d1f4c43dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba1b72c1-9997-4b27-a202-d5d1f4c43dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76766418-5be1-4403-bb11-93dfd99dd9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76766418-5be1-4403-bb11-93dfd99dd9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54fda538-00ea-4db8-a254-bb515c4d4174', 'volume_name': 'volume-54fda538-00ea-4db8-a254-bb515c4d4174', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6dbb802-3f83-4ae9-9997-b551a4f6c3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6dbb802-3f83-4ae9-9997-b551a4f6c3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8dfa0b-50b2-4e0a-9dac-c6914280dccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:21 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] Volume 54fda538-00ea-4db8-a254-bb515c4d4174: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54fda538-00ea-4db8-a254-bb515c4d4174', 'volume_size': 1} Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:21 devstack sudo[86032]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943.22f8d393-7149-4b66-9d7e-3db06b35e6fb" returned: 0 in 0.517s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Lock "cinder-quobyte-22f8d393-7149-4b66-9d7e-3db06b35e6fb" released by "_delete_snapshot" :: held 2.159s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.510s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.209s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1835962688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e82098b2-795e-406b-ad94-e210aa234e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a794ff33593e40b281c82a8b3b88a168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:10Z,use_quota=True,user_id='e214fb74808f4b5badd10d345dcd4c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] Creating volume e82098b2-795e-406b-ad94-e210aa234e18 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:21 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e82098b2-795e-406b-ad94-e210aa234e18 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:21 devstack sudo[86035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e82098b2-795e-406b-ad94-e210aa234e18 1073741824 Apr 10 10:36:21 devstack sudo[86035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be482aa-e776-49c8-a792-5bb65cb53d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b88f968d-f85c-4257-98f1-000c763bb4fd', 'volume_size': 2, 'source_volid': '6c61645f-cc48-4395-8da2-777288589943', 'source_volstatus': 'available'}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (244b6997-2c43-4517-910e-267b3d49e927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:21 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Volume volume-b88f968d-f85c-4257-98f1-000c763bb4fd (b88f968d-f85c-4257-98f1-000c763bb4fd): created successfully Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (244b6997-2c43-4517-910e-267b3d49e927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Flow 'volume_create_manager' (30eb3079-93bd-46b4-b0b9-4ef63a7c4e2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:21 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-846fb40b-e5b6-450a-9875-4c6ae6866391 tempest-VolumesCloneTest-842889893 None] Created volume successfully. Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-21456a63-a8c4-442c-930d-da6ce3cde5cb tempest-VolumesCloneTest-842889893 None] Acquiring lock "cinder-b88f968d-f85c-4257-98f1-000c763bb4fd-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-21456a63-a8c4-442c-930d-da6ce3cde5cb tempest-VolumesCloneTest-842889893 None] Lock "cinder-b88f968d-f85c-4257-98f1-000c763bb4fd-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-21456a63-a8c4-442c-930d-da6ce3cde5cb tempest-VolumesCloneTest-842889893 None] Acquiring lock "cinder-quobyte-b88f968d-f85c-4257-98f1-000c763bb4fd" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-21456a63-a8c4-442c-930d-da6ce3cde5cb tempest-VolumesCloneTest-842889893 None] Lock "cinder-quobyte-b88f968d-f85c-4257-98f1-000c763bb4fd" acquired by "delete_volume" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23fb26d-22ca-40d9-bd11-412a7e715163]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-21456a63-a8c4-442c-930d-da6ce3cde5cb tempest-VolumesCloneTest-842889893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b88f968d-f85c-4257-98f1-000c763bb4fd {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:22 devstack sudo[86040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b88f968d-f85c-4257-98f1-000c763bb4fd Apr 10 10:36:22 devstack sudo[86040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:22 devstack sudo[86035]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e82098b2-795e-406b-ad94-e210aa234e18 1073741824" returned: 0 in 0.591s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e82098b2-795e-406b-ad94-e210aa234e18 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:22 devstack sudo[86042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e82098b2-795e-406b-ad94-e210aa234e18 Apr 10 10:36:22 devstack sudo[86042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:22 devstack sudo[86040]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-21456a63-a8c4-442c-930d-da6ce3cde5cb tempest-VolumesCloneTest-842889893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b88f968d-f85c-4257-98f1-000c763bb4fd" returned: 0 in 0.540s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-21456a63-a8c4-442c-930d-da6ce3cde5cb tempest-VolumesCloneTest-842889893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b88f968d-f85c-4257-98f1-000c763bb4fd {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:22 devstack sudo[86048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b88f968d-f85c-4257-98f1-000c763bb4fd Apr 10 10:36:22 devstack sudo[86048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:22 devstack sudo[86042]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e82098b2-795e-406b-ad94-e210aa234e18" returned: 0 in 0.447s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.763s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1713632842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed1621c-7505-48f9-9f07-591fa799989d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac8dff469b3a4696854bd1315ae1726e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:18Z,use_quota=True,user_id='010c136674e949e9bbce61919300a3ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] Creating volume 3ed1621c-7505-48f9-9f07-591fa799989d {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:22 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:36:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:22 devstack sudo[86050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d 1073741824 Apr 10 10:36:22 devstack sudo[86050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c97d13a8-163a-4d07-845b-9ee2e3158afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e82098b2-795e-406b-ad94-e210aa234e18', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d975685-270f-45c6-b675-be2f959a1369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:22 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] Volume volume-e82098b2-795e-406b-ad94-e210aa234e18 (e82098b2-795e-406b-ad94-e210aa234e18): created successfully Apr 10 10:36:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d975685-270f-45c6-b675-be2f959a1369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] Flow 'volume_create_manager' (0b464b15-4b1a-442b-9718-b352a3074064) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:22 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-1b1f4246-6f99-467c-aec1-49faea83cf60 tempest-VolumesServicesTestJSON-1645273815 None] Created volume successfully. Apr 10 10:36:23 devstack sudo[86048]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-21456a63-a8c4-442c-930d-da6ce3cde5cb tempest-VolumesCloneTest-842889893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b88f968d-f85c-4257-98f1-000c763bb4fd" returned: 0 in 0.516s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-21456a63-a8c4-442c-930d-da6ce3cde5cb tempest-VolumesCloneTest-842889893 None] Lock "cinder-quobyte-b88f968d-f85c-4257-98f1-000c763bb4fd" released by "delete_volume" :: held 1.092s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-21456a63-a8c4-442c-930d-da6ce3cde5cb tempest-VolumesCloneTest-842889893 None] Created reservations ['1750511e-ea10-4c5f-a338-dcc295062497', '9582dfd7-6816-48e7-ba49-15dd1bed3e49', '12c7e587-e512-49cc-9b37-d97329182a51', '50ebb0ee-69a6-4d15-a0f9-02b447d37fcc'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-21456a63-a8c4-442c-930d-da6ce3cde5cb tempest-VolumesCloneTest-842889893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-21456a63-a8c4-442c-930d-da6ce3cde5cb tempest-VolumesCloneTest-842889893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-21456a63-a8c4-442c-930d-da6ce3cde5cb tempest-VolumesCloneTest-842889893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-21456a63-a8c4-442c-930d-da6ce3cde5cb tempest-VolumesCloneTest-842889893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-21456a63-a8c4-442c-930d-da6ce3cde5cb tempest-VolumesCloneTest-842889893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-21456a63-a8c4-442c-930d-da6ce3cde5cb tempest-VolumesCloneTest-842889893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:23 devstack sudo[86056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:36:23 devstack sudo[86056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:23 devstack sudo[86050]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d 1073741824" returned: 0 in 0.635s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:23 devstack sudo[86058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d Apr 10 10:36:23 devstack sudo[86058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-edf40cd5-0620-4d65-8152-a4d4b648b948 tempest-VolumesServicesTestJSON-1645273815 None] Acquiring lock "cinder-e82098b2-795e-406b-ad94-e210aa234e18-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-edf40cd5-0620-4d65-8152-a4d4b648b948 tempest-VolumesServicesTestJSON-1645273815 None] Lock "cinder-e82098b2-795e-406b-ad94-e210aa234e18-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-edf40cd5-0620-4d65-8152-a4d4b648b948 tempest-VolumesServicesTestJSON-1645273815 None] Acquiring lock "cinder-quobyte-e82098b2-795e-406b-ad94-e210aa234e18" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-edf40cd5-0620-4d65-8152-a4d4b648b948 tempest-VolumesServicesTestJSON-1645273815 None] Lock "cinder-quobyte-e82098b2-795e-406b-ad94-e210aa234e18" acquired by "delete_volume" :: waited 0.007s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[d849037b-51e4-493c-9f0d-fa4f4f4ab89a]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-edf40cd5-0620-4d65-8152-a4d4b648b948 tempest-VolumesServicesTestJSON-1645273815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e82098b2-795e-406b-ad94-e210aa234e18 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:23 devstack sudo[86060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e82098b2-795e-406b-ad94-e210aa234e18 Apr 10 10:36:23 devstack sudo[86060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:23 devstack sudo[86056]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-21456a63-a8c4-442c-930d-da6ce3cde5cb tempest-VolumesCloneTest-842889893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.533s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-21456a63-a8c4-442c-930d-da6ce3cde5cb tempest-VolumesCloneTest-842889893 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:23 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-21456a63-a8c4-442c-930d-da6ce3cde5cb tempest-VolumesCloneTest-842889893 None] Deleted volume successfully. Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-21456a63-a8c4-442c-930d-da6ce3cde5cb tempest-VolumesCloneTest-842889893 None] Lock "cinder-b88f968d-f85c-4257-98f1-000c763bb4fd-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:23 devstack sudo[86058]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d" returned: 0 in 0.518s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.505s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-335453935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54fda538-00ea-4db8-a254-bb515c4d4174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bfccb1031b842f0904bddb7077a4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:21Z,use_quota=True,user_id='efb6a88085154bda891275dfe3fbdc74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] Creating volume 54fda538-00ea-4db8-a254-bb515c4d4174 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:23 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-54fda538-00ea-4db8-a254-bb515c4d4174 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6643d9b1-6fd2-4566-bbc4-3a28838db161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ed1621c-7505-48f9-9f07-591fa799989d', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:23 devstack sudo[86064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-54fda538-00ea-4db8-a254-bb515c4d4174 1073741824 Apr 10 10:36:23 devstack sudo[86064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cf31caa-7c75-4e2c-a155-8d3ae6918bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:23 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] Volume volume-3ed1621c-7505-48f9-9f07-591fa799989d (3ed1621c-7505-48f9-9f07-591fa799989d): created successfully Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cf31caa-7c75-4e2c-a155-8d3ae6918bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:23 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] Flow 'volume_create_manager' (3dc8c8bb-d118-4196-b7f8-15b93d6a7265) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:23 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-8ac40073-bff6-452f-a54c-1be35f7d44d3 tempest-SnapshotMetadataTestJSON-48606805 None] Created volume successfully. Apr 10 10:36:23 devstack sudo[86060]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-edf40cd5-0620-4d65-8152-a4d4b648b948 tempest-VolumesServicesTestJSON-1645273815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e82098b2-795e-406b-ad94-e210aa234e18" returned: 0 in 0.616s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-edf40cd5-0620-4d65-8152-a4d4b648b948 tempest-VolumesServicesTestJSON-1645273815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e82098b2-795e-406b-ad94-e210aa234e18 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:24 devstack sudo[86069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e82098b2-795e-406b-ad94-e210aa234e18 Apr 10 10:36:24 devstack sudo[86069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-dcebb42d-03d7-4c3c-944f-ead4faff6ea8 tempest-SnapshotMetadataTestJSON-48606805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:24 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-3fb59b2e-c81e-4f4f-81ac-72b3a9d67633 tempest-VolumesCloneTest-842889893 None] Acquiring lock "cinder-6c61645f-cc48-4395-8da2-777288589943-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:24 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-3fb59b2e-c81e-4f4f-81ac-72b3a9d67633 tempest-VolumesCloneTest-842889893 None] Lock "cinder-6c61645f-cc48-4395-8da2-777288589943-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:24 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-3fb59b2e-c81e-4f4f-81ac-72b3a9d67633 tempest-VolumesCloneTest-842889893 None] Acquiring lock "cinder-quobyte-6c61645f-cc48-4395-8da2-777288589943" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:24 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-3fb59b2e-c81e-4f4f-81ac-72b3a9d67633 tempest-VolumesCloneTest-842889893 None] Lock "cinder-quobyte-6c61645f-cc48-4395-8da2-777288589943" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:24 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d2e0f0-4a2f-430a-8633-d0c7bf621dda]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3fb59b2e-c81e-4f4f-81ac-72b3a9d67633 tempest-VolumesCloneTest-842889893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:24 devstack sudo[86074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943 Apr 10 10:36:24 devstack sudo[86074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:24 devstack sudo[86064]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-54fda538-00ea-4db8-a254-bb515c4d4174 1073741824" returned: 0 in 0.655s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-54fda538-00ea-4db8-a254-bb515c4d4174 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:24 devstack sudo[86076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-54fda538-00ea-4db8-a254-bb515c4d4174 Apr 10 10:36:24 devstack sudo[86076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:24 devstack sudo[86069]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-edf40cd5-0620-4d65-8152-a4d4b648b948 tempest-VolumesServicesTestJSON-1645273815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e82098b2-795e-406b-ad94-e210aa234e18" returned: 0 in 0.712s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:24 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-edf40cd5-0620-4d65-8152-a4d4b648b948 tempest-VolumesServicesTestJSON-1645273815 None] Lock "cinder-quobyte-e82098b2-795e-406b-ad94-e210aa234e18" released by "delete_volume" :: held 1.353s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:24 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-edf40cd5-0620-4d65-8152-a4d4b648b948 tempest-VolumesServicesTestJSON-1645273815 None] Created reservations ['4e2abd78-4604-4c08-b5fd-f53d6e7549b3', '180e34a5-8ad1-4689-af78-e299d2703b4e', '0e6b4df8-9811-4371-b291-0c899ef29e1a', '9061b701-71f4-4f03-89ae-eab2b8111f2d'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-edf40cd5-0620-4d65-8152-a4d4b648b948 tempest-VolumesServicesTestJSON-1645273815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-edf40cd5-0620-4d65-8152-a4d4b648b948 tempest-VolumesServicesTestJSON-1645273815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:24 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-edf40cd5-0620-4d65-8152-a4d4b648b948 tempest-VolumesServicesTestJSON-1645273815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:24 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-edf40cd5-0620-4d65-8152-a4d4b648b948 tempest-VolumesServicesTestJSON-1645273815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-edf40cd5-0620-4d65-8152-a4d4b648b948 tempest-VolumesServicesTestJSON-1645273815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-edf40cd5-0620-4d65-8152-a4d4b648b948 tempest-VolumesServicesTestJSON-1645273815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:24 devstack sudo[86082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:36:24 devstack sudo[86082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:24 devstack sudo[86074]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3fb59b2e-c81e-4f4f-81ac-72b3a9d67633 tempest-VolumesCloneTest-842889893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943" returned: 0 in 0.558s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3fb59b2e-c81e-4f4f-81ac-72b3a9d67633 tempest-VolumesCloneTest-842889893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:24 devstack sudo[86084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943 Apr 10 10:36:24 devstack sudo[86084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:24 devstack sudo[86076]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-54fda538-00ea-4db8-a254-bb515c4d4174" returned: 0 in 0.529s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:24 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-dcebb42d-03d7-4c3c-944f-ead4faff6ea8 tempest-SnapshotMetadataTestJSON-48606805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.824s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8dfa0b-50b2-4e0a-9dac-c6914280dccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54fda538-00ea-4db8-a254-bb515c4d4174', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (484e24be-9a73-4d82-8825-efb2e010dd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:25 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] Volume volume-54fda538-00ea-4db8-a254-bb515c4d4174 (54fda538-00ea-4db8-a254-bb515c4d4174): created successfully Apr 10 10:36:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (484e24be-9a73-4d82-8825-efb2e010dd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] Flow 'volume_create_manager' (7e958c50-be77-4e1d-b06c-500fd02bc487) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-dcebb42d-03d7-4c3c-944f-ead4faff6ea8 tempest-SnapshotMetadataTestJSON-48606805 None] Creating offline snapshot 7440f5eb-bab9-4234-b5f0-619b629e89ed of volume 3ed1621c-7505-48f9-9f07-591fa799989d {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:36:25 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-5de36419-5a04-4699-965b-782366f8689c tempest-VolumesActionsTest-809678924 None] Created volume successfully. Apr 10 10:36:25 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[53072025-9c08-4ad0-a377-ce155db20ea3]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dcebb42d-03d7-4c3c-944f-ead4faff6ea8 tempest-SnapshotMetadataTestJSON-48606805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:25 devstack sudo[86087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d Apr 10 10:36:25 devstack sudo[86087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:25 devstack sudo[86082]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-edf40cd5-0620-4d65-8152-a4d4b648b948 tempest-VolumesServicesTestJSON-1645273815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.578s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:25 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-edf40cd5-0620-4d65-8152-a4d4b648b948 tempest-VolumesServicesTestJSON-1645273815 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:25 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-edf40cd5-0620-4d65-8152-a4d4b648b948 tempest-VolumesServicesTestJSON-1645273815 None] Deleted volume successfully. Apr 10 10:36:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-edf40cd5-0620-4d65-8152-a4d4b648b948 tempest-VolumesServicesTestJSON-1645273815 None] Lock "cinder-e82098b2-795e-406b-ad94-e210aa234e18-delete_volume" released by "delete_volume" :: held 2.074s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-15c2885f-71c2-46e6-8181-ed457139e4a5 tempest-VolumesActionsTest-809678924 None] Acquiring lock "cinder-54fda538-00ea-4db8-a254-bb515c4d4174" by "attach_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-15c2885f-71c2-46e6-8181-ed457139e4a5 tempest-VolumesActionsTest-809678924 None] Lock "cinder-54fda538-00ea-4db8-a254-bb515c4d4174" acquired by "attach_volume" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:25 devstack sudo[86084]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3fb59b2e-c81e-4f4f-81ac-72b3a9d67633 tempest-VolumesCloneTest-842889893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6c61645f-cc48-4395-8da2-777288589943" returned: 0 in 0.653s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-3fb59b2e-c81e-4f4f-81ac-72b3a9d67633 tempest-VolumesCloneTest-842889893 None] Lock "cinder-quobyte-6c61645f-cc48-4395-8da2-777288589943" released by "delete_volume" :: held 1.256s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:25 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-3fb59b2e-c81e-4f4f-81ac-72b3a9d67633 tempest-VolumesCloneTest-842889893 None] Created reservations ['ae463eab-8a84-46f0-873a-20e72a12f105', 'f60c0b3c-6233-4354-9d7c-cbf91ac5ede3', '73d798d3-ea14-47af-a304-fdde7625c6c9', '6e750b57-8f67-42fe-8800-91f925dacc5a'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3fb59b2e-c81e-4f4f-81ac-72b3a9d67633 tempest-VolumesCloneTest-842889893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3fb59b2e-c81e-4f4f-81ac-72b3a9d67633 tempest-VolumesCloneTest-842889893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3fb59b2e-c81e-4f4f-81ac-72b3a9d67633 tempest-VolumesCloneTest-842889893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3fb59b2e-c81e-4f4f-81ac-72b3a9d67633 tempest-VolumesCloneTest-842889893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3fb59b2e-c81e-4f4f-81ac-72b3a9d67633 tempest-VolumesCloneTest-842889893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3fb59b2e-c81e-4f4f-81ac-72b3a9d67633 tempest-VolumesCloneTest-842889893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:25 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-15c2885f-71c2-46e6-8181-ed457139e4a5 tempest-VolumesActionsTest-809678924 None] Attaching volume 54fda538-00ea-4db8-a254-bb515c4d4174 to instance 2dac84eb-aad6-4367-bb79-2920023501bb at mountpoint /dev/vdb on host None. Apr 10 10:36:25 devstack sudo[86094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:36:25 devstack sudo[86094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:25 devstack sudo[86087]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:25 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-15c2885f-71c2-46e6-8181-ed457139e4a5 tempest-VolumesActionsTest-809678924 None] Attach volume completed successfully. Apr 10 10:36:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dcebb42d-03d7-4c3c-944f-ead4faff6ea8 tempest-SnapshotMetadataTestJSON-48606805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d" returned: 0 in 0.651s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dcebb42d-03d7-4c3c-944f-ead4faff6ea8 tempest-SnapshotMetadataTestJSON-48606805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d.7440f5eb-bab9-4234-b5f0-619b629e89ed 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-15c2885f-71c2-46e6-8181-ed457139e4a5 tempest-VolumesActionsTest-809678924 None] Lock "cinder-54fda538-00ea-4db8-a254-bb515c4d4174" released by "attach_volume" :: held 0.219s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:25 devstack sudo[86096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d.7440f5eb-bab9-4234-b5f0-619b629e89ed 1G Apr 10 10:36:25 devstack sudo[86096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:26 devstack sudo[86094]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3fb59b2e-c81e-4f4f-81ac-72b3a9d67633 tempest-VolumesCloneTest-842889893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.588s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:26 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-3fb59b2e-c81e-4f4f-81ac-72b3a9d67633 tempest-VolumesCloneTest-842889893 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:26 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-3fb59b2e-c81e-4f4f-81ac-72b3a9d67633 tempest-VolumesCloneTest-842889893 None] Deleted volume successfully. Apr 10 10:36:26 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-3fb59b2e-c81e-4f4f-81ac-72b3a9d67633 tempest-VolumesCloneTest-842889893 None] Lock "cinder-6c61645f-cc48-4395-8da2-777288589943-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:26 devstack sudo[86096]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dcebb42d-03d7-4c3c-944f-ead4faff6ea8 tempest-SnapshotMetadataTestJSON-48606805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d.7440f5eb-bab9-4234-b5f0-619b629e89ed 1G" returned: 0 in 0.721s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dcebb42d-03d7-4c3c-944f-ead4faff6ea8 tempest-SnapshotMetadataTestJSON-48606805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ed1621c-7505-48f9-9f07-591fa799989d -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d.7440f5eb-bab9-4234-b5f0-619b629e89ed {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:26 devstack sudo[86102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ed1621c-7505-48f9-9f07-591fa799989d -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d.7440f5eb-bab9-4234-b5f0-619b629e89ed Apr 10 10:36:26 devstack sudo[86102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:26 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-c29f2855-4d5b-4965-9d47-9024b97b7e3e tempest-VolumesActionsTest-814240402 None] Terminate volume connection completed successfully. Apr 10 10:36:27 devstack sudo[86102]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dcebb42d-03d7-4c3c-944f-ead4faff6ea8 tempest-SnapshotMetadataTestJSON-48606805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ed1621c-7505-48f9-9f07-591fa799989d -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d.7440f5eb-bab9-4234-b5f0-619b629e89ed" returned: 0 in 0.672s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:27 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-dcebb42d-03d7-4c3c-944f-ead4faff6ea8 tempest-SnapshotMetadataTestJSON-48606805 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d.7440f5eb-bab9-4234-b5f0-619b629e89ed is being set with open permissions: ugo+rw Apr 10 10:36:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dcebb42d-03d7-4c3c-944f-ead4faff6ea8 tempest-SnapshotMetadataTestJSON-48606805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d.7440f5eb-bab9-4234-b5f0-619b629e89ed {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:27 devstack sudo[86107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d.7440f5eb-bab9-4234-b5f0-619b629e89ed Apr 10 10:36:27 devstack sudo[86107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:27 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c29f2855-4d5b-4965-9d47-9024b97b7e3e tempest-VolumesActionsTest-814240402 None] Acquiring lock "cinder-54fda538-00ea-4db8-a254-bb515c4d4174-detach_volume" by "detach_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:27 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c29f2855-4d5b-4965-9d47-9024b97b7e3e tempest-VolumesActionsTest-814240402 None] Lock "cinder-54fda538-00ea-4db8-a254-bb515c4d4174-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:27 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-c29f2855-4d5b-4965-9d47-9024b97b7e3e tempest-VolumesActionsTest-814240402 None] Detaching volume 54fda538-00ea-4db8-a254-bb515c4d4174 from instance 2dac84eb-aad6-4367-bb79-2920023501bb. Apr 10 10:36:27 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-c29f2855-4d5b-4965-9d47-9024b97b7e3e tempest-VolumesActionsTest-814240402 None] Detach volume completed successfully. Apr 10 10:36:27 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c29f2855-4d5b-4965-9d47-9024b97b7e3e tempest-VolumesActionsTest-814240402 None] Lock "cinder-54fda538-00ea-4db8-a254-bb515c4d4174-detach_volume" released by "detach_volume" :: held 0.125s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:28 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-91d9f45b-263b-4929-a17d-c009f87ef8f7 tempest-VolumesActionsTest-809678924 None] Acquiring lock "cinder-54fda538-00ea-4db8-a254-bb515c4d4174-detach_volume" by "detach_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:28 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-91d9f45b-263b-4929-a17d-c009f87ef8f7 tempest-VolumesActionsTest-809678924 None] Lock "cinder-54fda538-00ea-4db8-a254-bb515c4d4174-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:28 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-91d9f45b-263b-4929-a17d-c009f87ef8f7 tempest-VolumesActionsTest-809678924 None] Volume detach called, but volume not attached. Apr 10 10:36:28 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-91d9f45b-263b-4929-a17d-c009f87ef8f7 tempest-VolumesActionsTest-809678924 None] Lock "cinder-54fda538-00ea-4db8-a254-bb515c4d4174-detach_volume" released by "detach_volume" :: held 0.025s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:28 devstack sudo[86107]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dcebb42d-03d7-4c3c-944f-ead4faff6ea8 tempest-SnapshotMetadataTestJSON-48606805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d.7440f5eb-bab9-4234-b5f0-619b629e89ed" returned: 0 in 0.970s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dcebb42d-03d7-4c3c-944f-ead4faff6ea8 tempest-SnapshotMetadataTestJSON-48606805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:28 devstack sudo[86110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d.info Apr 10 10:36:28 devstack sudo[86110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:28 devstack sudo[86110]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dcebb42d-03d7-4c3c-944f-ead4faff6ea8 tempest-SnapshotMetadataTestJSON-48606805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d.info" returned: 0 in 0.575s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:28 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-dcebb42d-03d7-4c3c-944f-ead4faff6ea8 tempest-SnapshotMetadataTestJSON-48606805 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d.info is being set with open permissions: ugo+rw Apr 10 10:36:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dcebb42d-03d7-4c3c-944f-ead4faff6ea8 tempest-SnapshotMetadataTestJSON-48606805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:28 devstack sudo[86113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d.info Apr 10 10:36:28 devstack sudo[86113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:28 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7f2e2b59-f93c-4f3e-9c2b-d14a38e95c68 tempest-VolumesActionsTest-809678924 None] Acquiring lock "cinder-54fda538-00ea-4db8-a254-bb515c4d4174-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:28 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7f2e2b59-f93c-4f3e-9c2b-d14a38e95c68 tempest-VolumesActionsTest-809678924 None] Lock "cinder-54fda538-00ea-4db8-a254-bb515c4d4174-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:28 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7f2e2b59-f93c-4f3e-9c2b-d14a38e95c68 tempest-VolumesActionsTest-809678924 None] Acquiring lock "cinder-quobyte-54fda538-00ea-4db8-a254-bb515c4d4174" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:28 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7f2e2b59-f93c-4f3e-9c2b-d14a38e95c68 tempest-VolumesActionsTest-809678924 None] Lock "cinder-quobyte-54fda538-00ea-4db8-a254-bb515c4d4174" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:28 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1137b1c-a61b-44d7-b25a-5cd6b994658f]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f2e2b59-f93c-4f3e-9c2b-d14a38e95c68 tempest-VolumesActionsTest-809678924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-54fda538-00ea-4db8-a254-bb515c4d4174 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:28 devstack sudo[86115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-54fda538-00ea-4db8-a254-bb515c4d4174 Apr 10 10:36:28 devstack sudo[86115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:29 devstack sudo[86113]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dcebb42d-03d7-4c3c-944f-ead4faff6ea8 tempest-SnapshotMetadataTestJSON-48606805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d.info" returned: 0 in 0.602s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-dcebb42d-03d7-4c3c-944f-ead4faff6ea8 tempest-SnapshotMetadataTestJSON-48606805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.273s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:29 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-dcebb42d-03d7-4c3c-944f-ead4faff6ea8 tempest-SnapshotMetadataTestJSON-48606805 None] Create snapshot completed successfully Apr 10 10:36:29 devstack sudo[86115]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f2e2b59-f93c-4f3e-9c2b-d14a38e95c68 tempest-VolumesActionsTest-809678924 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-54fda538-00ea-4db8-a254-bb515c4d4174" returned: 0 in 0.864s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f2e2b59-f93c-4f3e-9c2b-d14a38e95c68 tempest-VolumesActionsTest-809678924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-54fda538-00ea-4db8-a254-bb515c4d4174 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:29 devstack sudo[86121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-54fda538-00ea-4db8-a254-bb515c4d4174 Apr 10 10:36:29 devstack sudo[86121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Flow 'volume_create_manager' (335cb1fd-cd90-4a18-a1fe-bfe8fa575796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c1eff08-c850-4df5-b0fc-580333c7ccb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c1eff08-c850-4df5-b0fc-580333c7ccb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1772017284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ff9505-19ab-4998-80b7-2f24fd358b2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7138da017053418585faa1fb4581654a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:30Z,use_quota=True,user_id='1bd37e1347214badaadad54406bb4af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad7b879c-b60d-43c1-afe1-8d8ca7953f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad7b879c-b60d-43c1-afe1-8d8ca7953f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f381c95b-3ca3-4fcb-bec8-e2cbe99d1708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG cinder.image.glance [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Creating Keystone auth plugin from conf {{(pid=81938) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 10 10:36:30 devstack sudo[86121]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f2e2b59-f93c-4f3e-9c2b-d14a38e95c68 tempest-VolumesActionsTest-809678924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-54fda538-00ea-4db8-a254-bb515c4d4174" returned: 0 in 0.746s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7f2e2b59-f93c-4f3e-9c2b-d14a38e95c68 tempest-VolumesActionsTest-809678924 None] Lock "cinder-quobyte-54fda538-00ea-4db8-a254-bb515c4d4174" released by "delete_volume" :: held 1.656s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f381c95b-3ca3-4fcb-bec8-e2cbe99d1708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a2ff9505-19ab-4998-80b7-2f24fd358b2f', 'volume_name': 'volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f', 'volume_size': 1, 'image_id': '8dcf7229-52df-43f5-84c5-2e0276bc541d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf7229-52df-43f5-84c5-2e0276bc541d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '52e7a0ecf90345dca974afb11cfc67b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8dcf7229-52df-43f5-84c5-2e0276bc541d', 'created_at': datetime.datetime(2026, 4, 10, 8, 27, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 27, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dcf7229-52df-43f5-84c5-2e0276bc541d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f310e7bc-064f-4c84-8314-2d3a0b17bedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f310e7bc-064f-4c84-8314-2d3a0b17bedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3f017a3-025e-482b-aa9a-c36e9ab500ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:30 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Volume a2ff9505-19ab-4998-80b7-2f24fd358b2f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f', 'volume_size': 1, 'image_id': '8dcf7229-52df-43f5-84c5-2e0276bc541d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf7229-52df-43f5-84c5-2e0276bc541d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '52e7a0ecf90345dca974afb11cfc67b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8dcf7229-52df-43f5-84c5-2e0276bc541d', 'created_at': datetime.datetime(2026, 4, 10, 8, 27, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 27, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dcf7229-52df-43f5-84c5-2e0276bc541d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Trying to clone a2ff9505-19ab-4998-80b7-2f24fd358b2f from image 8dcf7229-52df-43f5-84c5-2e0276bc541d at location (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf7229-52df-43f5-84c5-2e0276bc541d', 'metadata': {}}]). {{(pid=81938) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-eaea3006-580f-484c-9bdd-9817eff54310 tempest-SnapshotMetadataTestJSON-48606805 None] Acquiring lock "cinder-7440f5eb-bab9-4234-b5f0-619b629e89ed-delete_snapshot" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-eaea3006-580f-484c-9bdd-9817eff54310 tempest-SnapshotMetadataTestJSON-48606805 None] Lock "cinder-7440f5eb-bab9-4234-b5f0-619b629e89ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-eaea3006-580f-484c-9bdd-9817eff54310 tempest-SnapshotMetadataTestJSON-48606805 None] Acquiring lock "cinder-quobyte-3ed1621c-7505-48f9-9f07-591fa799989d" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-eaea3006-580f-484c-9bdd-9817eff54310 tempest-SnapshotMetadataTestJSON-48606805 None] Lock "cinder-quobyte-3ed1621c-7505-48f9-9f07-591fa799989d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-eaea3006-580f-484c-9bdd-9817eff54310 tempest-SnapshotMetadataTestJSON-48606805 None] Acquiring lock "cinder-quobyte-7440f5eb-bab9-4234-b5f0-619b629e89ed" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-eaea3006-580f-484c-9bdd-9817eff54310 tempest-SnapshotMetadataTestJSON-48606805 None] Lock "cinder-quobyte-7440f5eb-bab9-4234-b5f0-619b629e89ed" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-eaea3006-580f-484c-9bdd-9817eff54310 tempest-SnapshotMetadataTestJSON-48606805 None] Deleting offline snapshot 7440f5eb-bab9-4234-b5f0-619b629e89ed of volume 3ed1621c-7505-48f9-9f07-591fa799989d {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-eaea3006-580f-484c-9bdd-9817eff54310 tempest-SnapshotMetadataTestJSON-48606805 None] snapshot_file for this snap is: volume-3ed1621c-7505-48f9-9f07-591fa799989d.7440f5eb-bab9-4234-b5f0-619b629e89ed {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ce2335-9b4a-4963-b657-0e26868ad592]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-eaea3006-580f-484c-9bdd-9817eff54310 tempest-SnapshotMetadataTestJSON-48606805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d.7440f5eb-bab9-4234-b5f0-619b629e89ed {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-7f2e2b59-f93c-4f3e-9c2b-d14a38e95c68 tempest-VolumesActionsTest-809678924 None] Created reservations ['44b6cda7-9848-4490-807d-7885f770ffc3', '0379fa72-a121-4cbe-8b18-4de6fe7ce791', 'e6595dc7-3932-423b-a48a-20b1043361f2', '1dc436c7-80c8-45f4-be42-bd3f984ca691'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f2e2b59-f93c-4f3e-9c2b-d14a38e95c68 tempest-VolumesActionsTest-809678924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f2e2b59-f93c-4f3e-9c2b-d14a38e95c68 tempest-VolumesActionsTest-809678924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f2e2b59-f93c-4f3e-9c2b-d14a38e95c68 tempest-VolumesActionsTest-809678924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f2e2b59-f93c-4f3e-9c2b-d14a38e95c68 tempest-VolumesActionsTest-809678924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f2e2b59-f93c-4f3e-9c2b-d14a38e95c68 tempest-VolumesActionsTest-809678924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f2e2b59-f93c-4f3e-9c2b-d14a38e95c68 tempest-VolumesActionsTest-809678924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:30 devstack sudo[86125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d.7440f5eb-bab9-4234-b5f0-619b629e89ed Apr 10 10:36:30 devstack sudo[86125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:30 devstack sudo[86127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:36:30 devstack sudo[86127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_p8au28pldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81938) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 10 10:36:30 devstack cinder-volume[81938]: INFO cinder.image.image_utils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Image download 20.69 MB at 20.69 MB/s Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[c086fda1-c513-4e22-b67d-462ec27ac4da]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_p8au28pldevstack@QuobyteHD {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:31 devstack sudo[86130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_p8au28pldevstack@QuobyteHD Apr 10 10:36:31 devstack sudo[86130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:31 devstack sudo[86127]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f2e2b59-f93c-4f3e-9c2b-d14a38e95c68 tempest-VolumesActionsTest-809678924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.766s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:31 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-7f2e2b59-f93c-4f3e-9c2b-d14a38e95c68 tempest-VolumesActionsTest-809678924 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:31 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-7f2e2b59-f93c-4f3e-9c2b-d14a38e95c68 tempest-VolumesActionsTest-809678924 None] Deleted volume successfully. Apr 10 10:36:31 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7f2e2b59-f93c-4f3e-9c2b-d14a38e95c68 tempest-VolumesActionsTest-809678924 None] Lock "cinder-54fda538-00ea-4db8-a254-bb515c4d4174-delete_volume" released by "delete_volume" :: held 2.784s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:31 devstack sudo[86125]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-eaea3006-580f-484c-9bdd-9817eff54310 tempest-SnapshotMetadataTestJSON-48606805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d.7440f5eb-bab9-4234-b5f0-619b629e89ed" returned: 0 in 0.963s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:31 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-eaea3006-580f-484c-9bdd-9817eff54310 tempest-SnapshotMetadataTestJSON-48606805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ed1621c-7505-48f9-9f07-591fa799989d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:36:31 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9af0def-cdbd-48cf-8128-2e1d3822b09f]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-eaea3006-580f-484c-9bdd-9817eff54310 tempest-SnapshotMetadataTestJSON-48606805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:31 devstack sudo[86138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d Apr 10 10:36:31 devstack sudo[86138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:31 devstack sudo[86130]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_p8au28pldevstack@QuobyteHD" returned: 0 in 1.072s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:31 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Temporary image 8dcf7229-52df-43f5-84c5-2e0276bc541d is fetched for user 1bd37e1347214badaadad54406bb4af0. {{(pid=81938) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 10 10:36:31 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78ea027-530c-4893-a687-c7427cdc6663]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_p8au28pldevstack@QuobyteHD {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:32 devstack sudo[86143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_p8au28pldevstack@QuobyteHD Apr 10 10:36:32 devstack sudo[86143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:32 devstack sudo[86138]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-eaea3006-580f-484c-9bdd-9817eff54310 tempest-SnapshotMetadataTestJSON-48606805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d" returned: 0 in 0.784s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-eaea3006-580f-484c-9bdd-9817eff54310 tempest-SnapshotMetadataTestJSON-48606805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d.7440f5eb-bab9-4234-b5f0-619b629e89ed {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:32 devstack sudo[86157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d.7440f5eb-bab9-4234-b5f0-619b629e89ed Apr 10 10:36:32 devstack sudo[86157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:32 devstack sudo[86143]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_p8au28pldevstack@QuobyteHD" returned: 0 in 0.778s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:32 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1772017284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ff9505-19ab-4998-80b7-2f24fd358b2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7138da017053418585faa1fb4581654a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:30Z,use_quota=True,user_id='1bd37e1347214badaadad54406bb4af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:32 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Creating volume a2ff9505-19ab-4998-80b7-2f24fd358b2f {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:32 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:32 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:32 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:32 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:36:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:32 devstack sudo[86178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f 1073741824 Apr 10 10:36:32 devstack sudo[86178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:33 devstack sudo[86157]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-eaea3006-580f-484c-9bdd-9817eff54310 tempest-SnapshotMetadataTestJSON-48606805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d.7440f5eb-bab9-4234-b5f0-619b629e89ed" returned: 0 in 0.764s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-eaea3006-580f-484c-9bdd-9817eff54310 tempest-SnapshotMetadataTestJSON-48606805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d.7440f5eb-bab9-4234-b5f0-619b629e89ed {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:33 devstack sudo[86183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d.7440f5eb-bab9-4234-b5f0-619b629e89ed Apr 10 10:36:33 devstack sudo[86183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:33 devstack sudo[86178]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f 1073741824" returned: 0 in 0.687s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:33 devstack sudo[86190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f Apr 10 10:36:33 devstack sudo[86190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:33 devstack sudo[86183]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-eaea3006-580f-484c-9bdd-9817eff54310 tempest-SnapshotMetadataTestJSON-48606805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d.7440f5eb-bab9-4234-b5f0-619b629e89ed" returned: 0 in 0.605s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:33 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-eaea3006-580f-484c-9bdd-9817eff54310 tempest-SnapshotMetadataTestJSON-48606805 None] Lock "cinder-quobyte-7440f5eb-bab9-4234-b5f0-619b629e89ed" released by "_delete_snapshot" :: held 3.201s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:33 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-eaea3006-580f-484c-9bdd-9817eff54310 tempest-SnapshotMetadataTestJSON-48606805 None] Lock "cinder-quobyte-3ed1621c-7505-48f9-9f07-591fa799989d" released by "delete_snapshot" :: held 3.224s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:33 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-eaea3006-580f-484c-9bdd-9817eff54310 tempest-SnapshotMetadataTestJSON-48606805 None] Created reservations ['2075844a-d1d7-4116-868c-e9a22b422b7f', '7e0b8139-d456-46b0-9fd2-d30a83a5951f', '1e51e5c6-711f-49ab-9e46-25fa1fd1e316', 'c43571c2-6ee9-44ee-b264-cc05013d699f'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:33 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-eaea3006-580f-484c-9bdd-9817eff54310 tempest-SnapshotMetadataTestJSON-48606805 None] Delete snapshot completed successfully. Apr 10 10:36:33 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-eaea3006-580f-484c-9bdd-9817eff54310 tempest-SnapshotMetadataTestJSON-48606805 None] Lock "cinder-7440f5eb-bab9-4234-b5f0-619b629e89ed-delete_snapshot" released by "delete_snapshot" :: held 3.341s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:34 devstack sudo[86190]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f" returned: 0 in 0.659s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:34 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:34 devstack cinder-volume[81938]: DEBUG cinder.volume.volume_utils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Attempting download of 8dcf7229-52df-43f5-84c5-2e0276bc541d ((None, [{'url': 'file:///opt/stack/data/glance/images/8dcf7229-52df-43f5-84c5-2e0276bc541d', 'metadata': {}}])) to volume a2ff9505-19ab-4998-80b7-2f24fd358b2f. {{(pid=81938) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 10 10:36:34 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c07b745-a295-488c-ada2-0b47ed97b36b]: (4, 'raw') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dcf7229-52df-43f5-84c5-2e0276bc541d_far79z8i {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:34 devstack sudo[86196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dcf7229-52df-43f5-84c5-2e0276bc541d_far79z8i Apr 10 10:36:34 devstack sudo[86196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:34 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-d3c03073-7706-4944-b808-4f43296e688a tempest-SnapshotMetadataTestJSON-48606805 None] Acquiring lock "cinder-3ed1621c-7505-48f9-9f07-591fa799989d-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:34 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-d3c03073-7706-4944-b808-4f43296e688a tempest-SnapshotMetadataTestJSON-48606805 None] Lock "cinder-3ed1621c-7505-48f9-9f07-591fa799989d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:34 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-d3c03073-7706-4944-b808-4f43296e688a tempest-SnapshotMetadataTestJSON-48606805 None] Acquiring lock "cinder-quobyte-3ed1621c-7505-48f9-9f07-591fa799989d" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:34 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-d3c03073-7706-4944-b808-4f43296e688a tempest-SnapshotMetadataTestJSON-48606805 None] Lock "cinder-quobyte-3ed1621c-7505-48f9-9f07-591fa799989d" acquired by "delete_volume" :: waited 0.011s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:34 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09bd3ab-6a6f-4600-b577-296a8adcb311]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d3c03073-7706-4944-b808-4f43296e688a tempest-SnapshotMetadataTestJSON-48606805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:34 devstack sudo[86196]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dcf7229-52df-43f5-84c5-2e0276bc541d_far79z8i" returned: 0 in 0.784s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf7229-52df-43f5-84c5-2e0276bc541d_far79z8i {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:35 devstack sudo[86202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d Apr 10 10:36:35 devstack sudo[86202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:35 devstack sudo[86203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf7229-52df-43f5-84c5-2e0276bc541d_far79z8i Apr 10 10:36:35 devstack sudo[86203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:35 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Flow 'volume_create_manager' (f9844dcb-7c9d-4870-8a0f-26d8ebab3334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5f8c33-159b-4216-9fb5-f85d09135bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5f8c33-159b-4216-9fb5-f85d09135bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1445569500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a6ffd23-af3d-44eb-a387-fb0dcca22555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d968b64e3e554543ba9a5579c92cfb0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:35Z,use_quota=True,user_id='4bdbe981db2e44a88e1ff8fec69fcbf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c447419-ba76-445f-b242-09c3f4680497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c447419-ba76-445f-b242-09c3f4680497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28eded5d-9968-4e33-a896-7a002a7e1231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:35 devstack cinder-volume[81938]: DEBUG cinder.image.glance [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Creating Keystone auth plugin from conf {{(pid=81938) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 10 10:36:35 devstack sudo[86203]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf7229-52df-43f5-84c5-2e0276bc541d_far79z8i" returned: 1 in 0.622s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf7229-52df-43f5-84c5-2e0276bc541d_far79z8i' failed. Not Retrying. {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:36:35 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[83623c4b-e24e-404f-bd3e-0d0c0b73202e]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_p8au28pldevstack@QuobyteHD {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:35 devstack sudo[86202]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d3c03073-7706-4944-b808-4f43296e688a tempest-SnapshotMetadataTestJSON-48606805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d" returned: 0 in 0.731s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d3c03073-7706-4944-b808-4f43296e688a tempest-SnapshotMetadataTestJSON-48606805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:35 devstack sudo[86212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d Apr 10 10:36:35 devstack sudo[86212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28eded5d-9968-4e33-a896-7a002a7e1231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4a6ffd23-af3d-44eb-a387-fb0dcca22555', 'volume_name': 'volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555', 'volume_size': 1, 'image_id': '8dcf7229-52df-43f5-84c5-2e0276bc541d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf7229-52df-43f5-84c5-2e0276bc541d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '52e7a0ecf90345dca974afb11cfc67b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8dcf7229-52df-43f5-84c5-2e0276bc541d', 'created_at': datetime.datetime(2026, 4, 10, 8, 27, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 27, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dcf7229-52df-43f5-84c5-2e0276bc541d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e65d9a4-b96e-4559-93c6-7f5569f68623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e65d9a4-b96e-4559-93c6-7f5569f68623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df86bb4-373c-4752-8e1b-dd314e235e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:35 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Volume 4a6ffd23-af3d-44eb-a387-fb0dcca22555: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555', 'volume_size': 1, 'image_id': '8dcf7229-52df-43f5-84c5-2e0276bc541d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf7229-52df-43f5-84c5-2e0276bc541d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '52e7a0ecf90345dca974afb11cfc67b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8dcf7229-52df-43f5-84c5-2e0276bc541d', 'created_at': datetime.datetime(2026, 4, 10, 8, 27, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 27, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dcf7229-52df-43f5-84c5-2e0276bc541d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 10 10:36:35 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Trying to clone 4a6ffd23-af3d-44eb-a387-fb0dcca22555 from image 8dcf7229-52df-43f5-84c5-2e0276bc541d at location (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf7229-52df-43f5-84c5-2e0276bc541d', 'metadata': {}}]). {{(pid=81938) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 10 10:36:35 devstack sudo[86211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_p8au28pldevstack@QuobyteHD Apr 10 10:36:35 devstack sudo[86211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:35 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_najptgt9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81938) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 10 10:36:35 devstack cinder-volume[81938]: INFO cinder.image.image_utils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Image download 20.69 MB at 20.69 MB/s Apr 10 10:36:35 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfa254d-b006-42ec-8795-6768a72e3e74]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_najptgt9devstack@QuobyteHD {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:36 devstack sudo[86216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_najptgt9devstack@QuobyteHD Apr 10 10:36:36 devstack sudo[86216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:36 devstack sudo[86212]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d3c03073-7706-4944-b808-4f43296e688a tempest-SnapshotMetadataTestJSON-48606805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3ed1621c-7505-48f9-9f07-591fa799989d" returned: 0 in 0.552s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:36 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-d3c03073-7706-4944-b808-4f43296e688a tempest-SnapshotMetadataTestJSON-48606805 None] Lock "cinder-quobyte-3ed1621c-7505-48f9-9f07-591fa799989d" released by "delete_volume" :: held 1.338s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:36 devstack sudo[86211]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_p8au28pldevstack@QuobyteHD" returned: 0 in 0.619s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:36 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] 8dcf7229-52df-43f5-84c5-2e0276bc541d was qcow2, converting to raw {{(pid=81938) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 10 10:36:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_p8au28pldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:36 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-d3c03073-7706-4944-b808-4f43296e688a tempest-SnapshotMetadataTestJSON-48606805 None] Created reservations ['f7ab34fa-7f14-42ff-a389-28e5129b5da5', '06390498-e973-41f8-8ac5-6f56b47d7a32', 'db8475ef-dfe1-4702-a450-b4e87b1b1493', 'fb5dc639-d6b4-4ab7-9465-0325a29ea5a0'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:36 devstack sudo[86222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_p8au28pldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f Apr 10 10:36:36 devstack sudo[86222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d3c03073-7706-4944-b808-4f43296e688a tempest-SnapshotMetadataTestJSON-48606805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d3c03073-7706-4944-b808-4f43296e688a tempest-SnapshotMetadataTestJSON-48606805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:36 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-d3c03073-7706-4944-b808-4f43296e688a tempest-SnapshotMetadataTestJSON-48606805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:36 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-d3c03073-7706-4944-b808-4f43296e688a tempest-SnapshotMetadataTestJSON-48606805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d3c03073-7706-4944-b808-4f43296e688a tempest-SnapshotMetadataTestJSON-48606805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d3c03073-7706-4944-b808-4f43296e688a tempest-SnapshotMetadataTestJSON-48606805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:36 devstack sudo[86224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:36:36 devstack sudo[86224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:36 devstack sudo[86216]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_najptgt9devstack@QuobyteHD" returned: 0 in 0.613s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:36 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Temporary image 8dcf7229-52df-43f5-84c5-2e0276bc541d is fetched for user 4bdbe981db2e44a88e1ff8fec69fcbf3. {{(pid=81938) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 10 10:36:36 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5824973-0c28-494f-a8ef-be3e04a4bb20]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_najptgt9devstack@QuobyteHD {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:36 devstack sudo[86229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_najptgt9devstack@QuobyteHD Apr 10 10:36:36 devstack sudo[86229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:36 devstack sudo[86224]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d3c03073-7706-4944-b808-4f43296e688a tempest-SnapshotMetadataTestJSON-48606805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.514s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:36 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-d3c03073-7706-4944-b808-4f43296e688a tempest-SnapshotMetadataTestJSON-48606805 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:36 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-d3c03073-7706-4944-b808-4f43296e688a tempest-SnapshotMetadataTestJSON-48606805 None] Deleted volume successfully. Apr 10 10:36:36 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-d3c03073-7706-4944-b808-4f43296e688a tempest-SnapshotMetadataTestJSON-48606805 None] Lock "cinder-3ed1621c-7505-48f9-9f07-591fa799989d-delete_volume" released by "delete_volume" :: held 2.121s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:37 devstack sudo[86229]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_najptgt9devstack@QuobyteHD" returned: 0 in 0.606s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:37 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1445569500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a6ffd23-af3d-44eb-a387-fb0dcca22555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d968b64e3e554543ba9a5579c92cfb0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:35Z,use_quota=True,user_id='4bdbe981db2e44a88e1ff8fec69fcbf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:37 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Creating volume 4a6ffd23-af3d-44eb-a387-fb0dcca22555 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:37 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:37 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:37 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:37 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:36:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:37 devstack sudo[86250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555 1073741824 Apr 10 10:36:37 devstack sudo[86250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:37 devstack sudo[86222]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_p8au28pldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f" returned: 0 in 1.282s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:37 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_p8au28pldevstack@QuobyteHD, size 112.00 MB, duration 1.28 sec, destination /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f {{(pid=81938) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:36:37 devstack cinder-volume[81938]: INFO cinder.image.image_utils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Converted 112.00 MB image at 87.17 MB/s Apr 10 10:36:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:37 devstack sudo[86252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f 1G Apr 10 10:36:37 devstack sudo[86252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:38 devstack sudo[86250]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555 1073741824" returned: 0 in 0.806s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:38 devstack sudo[86260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555 Apr 10 10:36:38 devstack sudo[86260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:38 devstack sudo[86252]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f 1G" returned: 0 in 0.690s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:38 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40098fa-871b-452d-a029-f6e400b921b3]: (4, 'raw') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:38 devstack sudo[86262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f Apr 10 10:36:38 devstack sudo[86262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:38 devstack sudo[86260]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555" returned: 0 in 0.730s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:38 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:38 devstack cinder-volume[81938]: DEBUG cinder.volume.volume_utils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Attempting download of 8dcf7229-52df-43f5-84c5-2e0276bc541d ((None, [{'url': 'file:///opt/stack/data/glance/images/8dcf7229-52df-43f5-84c5-2e0276bc541d', 'metadata': {}}])) to volume 4a6ffd23-af3d-44eb-a387-fb0dcca22555. {{(pid=81938) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 10 10:36:38 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23dc568-3fc9-4915-bc97-fd783b3f5c6e]: (4, 'raw') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dcf7229-52df-43f5-84c5-2e0276bc541d_a5ud22td {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:38 devstack sudo[86262]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f" returned: 0 in 0.661s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:38 devstack sudo[86267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dcf7229-52df-43f5-84c5-2e0276bc541d_a5ud22td Apr 10 10:36:38 devstack sudo[86267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:39 devstack sudo[86268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f Apr 10 10:36:39 devstack sudo[86268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] Flow 'volume_create_manager' (a0babf72-6b07-459a-8788-b1bc252b03c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea286684-3f25-4bdc-a9ce-a488555c2577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea286684-3f25-4bdc-a9ce-a488555c2577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-558257476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b939da0-c4e6-4291-83ec-2417ac49b944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bfccb1031b842f0904bddb7077a4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:39Z,use_quota=True,user_id='efb6a88085154bda891275dfe3fbdc74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26dff561-3436-4bc9-b953-3e9dbfbe5d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26dff561-3436-4bc9-b953-3e9dbfbe5d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c8c822-0635-426b-936b-da888e31a8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c8c822-0635-426b-936b-da888e31a8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b939da0-c4e6-4291-83ec-2417ac49b944', 'volume_name': 'volume-4b939da0-c4e6-4291-83ec-2417ac49b944', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e8a91f-63fa-4bfd-901d-a139eddf8675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e8a91f-63fa-4bfd-901d-a139eddf8675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf5e2a8-2cd1-4eb3-a1b1-6b749af8791f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:39 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] Volume 4b939da0-c4e6-4291-83ec-2417ac49b944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b939da0-c4e6-4291-83ec-2417ac49b944', 'volume_size': 1} Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-558257476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b939da0-c4e6-4291-83ec-2417ac49b944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bfccb1031b842f0904bddb7077a4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:39Z,use_quota=True,user_id='efb6a88085154bda891275dfe3fbdc74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] Creating volume 4b939da0-c4e6-4291-83ec-2417ac49b944 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:39 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4b939da0-c4e6-4291-83ec-2417ac49b944 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:39 devstack sudo[86276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4b939da0-c4e6-4291-83ec-2417ac49b944 1073741824 Apr 10 10:36:39 devstack sudo[86276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:39 devstack sudo[86268]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f" returned: 1 in 0.702s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f' failed. Not Retrying. {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG cinder.volume.volume_utils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Downloaded image 8dcf7229-52df-43f5-84c5-2e0276bc541d ((None, [{'url': 'file:///opt/stack/data/glance/images/8dcf7229-52df-43f5-84c5-2e0276bc541d', 'metadata': {}}])) to volume a2ff9505-19ab-4998-80b7-2f24fd358b2f successfully. {{(pid=81938) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Temporary image 8dcf7229-52df-43f5-84c5-2e0276bc541d for user 1bd37e1347214badaadad54406bb4af0 is deleted. {{(pid=81938) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG cinder.volume.volume_utils [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Marking volume a2ff9505-19ab-4998-80b7-2f24fd358b2f as bootable. {{(pid=81938) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 10 10:36:39 devstack sudo[86267]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dcf7229-52df-43f5-84c5-2e0276bc541d_a5ud22td" returned: 0 in 0.763s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf7229-52df-43f5-84c5-2e0276bc541d_a5ud22td {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Copying metadata from image 8dcf7229-52df-43f5-84c5-2e0276bc541d to a2ff9505-19ab-4998-80b7-2f24fd358b2f. {{(pid=81938) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Creating volume glance metadata for volume a2ff9505-19ab-4998-80b7-2f24fd358b2f backed by image 8dcf7229-52df-43f5-84c5-2e0276bc541d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8dcf7229-52df-43f5-84c5-2e0276bc541d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81938) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3f017a3-025e-482b-aa9a-c36e9ab500ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f', 'volume_size': 1, 'image_id': '8dcf7229-52df-43f5-84c5-2e0276bc541d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf7229-52df-43f5-84c5-2e0276bc541d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '52e7a0ecf90345dca974afb11cfc67b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8dcf7229-52df-43f5-84c5-2e0276bc541d', 'created_at': datetime.datetime(2026, 4, 10, 8, 27, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 27, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dcf7229-52df-43f5-84c5-2e0276bc541d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ccc917-ef41-472f-a2c4-6a30fa6e08f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:39 devstack sudo[86278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf7229-52df-43f5-84c5-2e0276bc541d_a5ud22td Apr 10 10:36:39 devstack sudo[86278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:39 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Volume volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f (a2ff9505-19ab-4998-80b7-2f24fd358b2f): created successfully Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ccc917-ef41-472f-a2c4-6a30fa6e08f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:39 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Flow 'volume_create_manager' (335cb1fd-cd90-4a18-a1fe-bfe8fa575796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:39 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-67beab8c-eb12-46e7-9fae-1b7929cfc43f tempest-VolumesExtendTest-359827302 None] Created volume successfully. Apr 10 10:36:40 devstack sudo[86276]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4b939da0-c4e6-4291-83ec-2417ac49b944 1073741824" returned: 0 in 0.659s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4b939da0-c4e6-4291-83ec-2417ac49b944 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:40 devstack sudo[86286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4b939da0-c4e6-4291-83ec-2417ac49b944 Apr 10 10:36:40 devstack sudo[86286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:40 devstack sudo[86278]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf7229-52df-43f5-84c5-2e0276bc541d_a5ud22td" returned: 1 in 0.621s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf7229-52df-43f5-84c5-2e0276bc541d_a5ud22td' failed. Not Retrying. {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1c6a8e-554b-4f2f-8e56-0959b1e50949]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_najptgt9devstack@QuobyteHD {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] Flow 'volume_create_manager' (760d0899-4793-48b5-9538-bdd4fe797739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2bdc91f-1ecb-413b-b187-404643cd3dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:40 devstack sudo[86288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_najptgt9devstack@QuobyteHD Apr 10 10:36:40 devstack sudo[86288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2bdc91f-1ecb-413b-b187-404643cd3dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-706949904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd2913b4-48b0-408b-9024-cafd6730edd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fa9300a43ae415596ad2d192a7d69ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:40Z,use_quota=True,user_id='69dabf3f3aa3499c98ec483ba3f50e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fcffbb5-9e6d-4e3d-8a67-21d822ecdba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fcffbb5-9e6d-4e3d-8a67-21d822ecdba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40db5083-ac07-44bc-81f2-0344e4df87f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40db5083-ac07-44bc-81f2-0344e4df87f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd2913b4-48b0-408b-9024-cafd6730edd4', 'volume_name': 'volume-bd2913b4-48b0-408b-9024-cafd6730edd4', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c35184d-8169-4204-8e45-c8f5aea76435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c35184d-8169-4204-8e45-c8f5aea76435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a595a6d5-3396-4cfe-9148-a939ef2d2f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:40 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] Volume bd2913b4-48b0-408b-9024-cafd6730edd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd2913b4-48b0-408b-9024-cafd6730edd4', 'volume_size': 1} Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:40 devstack sudo[86286]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4b939da0-c4e6-4291-83ec-2417ac49b944" returned: 0 in 0.433s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.251s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-706949904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd2913b4-48b0-408b-9024-cafd6730edd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fa9300a43ae415596ad2d192a7d69ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:40Z,use_quota=True,user_id='69dabf3f3aa3499c98ec483ba3f50e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] Creating volume bd2913b4-48b0-408b-9024-cafd6730edd4 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:40 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bd2913b4-48b0-408b-9024-cafd6730edd4 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:40 devstack sudo[86291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bd2913b4-48b0-408b-9024-cafd6730edd4 1073741824 Apr 10 10:36:40 devstack sudo[86291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf5e2a8-2cd1-4eb3-a1b1-6b749af8791f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b939da0-c4e6-4291-83ec-2417ac49b944', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c559db7f-5046-412f-8520-e472eba7a796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:40 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] Volume volume-4b939da0-c4e6-4291-83ec-2417ac49b944 (4b939da0-c4e6-4291-83ec-2417ac49b944): created successfully Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c559db7f-5046-412f-8520-e472eba7a796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] Flow 'volume_create_manager' (a0babf72-6b07-459a-8788-b1bc252b03c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:40 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-7dc3f37b-54da-4306-a741-3ebc61614d58 tempest-VolumesActionsTest-809678924 None] Created volume successfully. Apr 10 10:36:40 devstack sudo[86288]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_najptgt9devstack@QuobyteHD" returned: 0 in 0.537s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] 8dcf7229-52df-43f5-84c5-2e0276bc541d was qcow2, converting to raw {{(pid=81938) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_najptgt9devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:40 devstack sudo[86296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_najptgt9devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555 Apr 10 10:36:40 devstack sudo[86296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-066da2b7-1e6a-4aed-ae52-7372ae31db59 tempest-VolumesExtendTest-359827302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:41 devstack sudo[86291]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bd2913b4-48b0-408b-9024-cafd6730edd4 1073741824" returned: 0 in 0.587s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bd2913b4-48b0-408b-9024-cafd6730edd4 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:41 devstack sudo[86307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bd2913b4-48b0-408b-9024-cafd6730edd4 Apr 10 10:36:41 devstack sudo[86307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:41 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a51f3926-b4ef-4743-8560-e05bb2a9cc70 tempest-VolumesActionsTest-814240402 None] Acquiring lock "cinder-4b939da0-c4e6-4291-83ec-2417ac49b944-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:41 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a51f3926-b4ef-4743-8560-e05bb2a9cc70 tempest-VolumesActionsTest-814240402 None] Lock "cinder-4b939da0-c4e6-4291-83ec-2417ac49b944-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:41 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a51f3926-b4ef-4743-8560-e05bb2a9cc70 tempest-VolumesActionsTest-814240402 None] Acquiring lock "cinder-quobyte-4b939da0-c4e6-4291-83ec-2417ac49b944" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:41 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a51f3926-b4ef-4743-8560-e05bb2a9cc70 tempest-VolumesActionsTest-814240402 None] Lock "cinder-quobyte-4b939da0-c4e6-4291-83ec-2417ac49b944" acquired by "delete_volume" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:41 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfa7898-e1eb-4756-9f5c-922d745f8358]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a51f3926-b4ef-4743-8560-e05bb2a9cc70 tempest-VolumesActionsTest-814240402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4b939da0-c4e6-4291-83ec-2417ac49b944 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:41 devstack sudo[86307]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bd2913b4-48b0-408b-9024-cafd6730edd4" returned: 0 in 0.551s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:41 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-066da2b7-1e6a-4aed-ae52-7372ae31db59 tempest-VolumesExtendTest-359827302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.836s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:41 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a595a6d5-3396-4cfe-9148-a939ef2d2f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd2913b4-48b0-408b-9024-cafd6730edd4', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:41 devstack sudo[86310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4b939da0-c4e6-4291-83ec-2417ac49b944 Apr 10 10:36:41 devstack sudo[86310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:41 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30640f1f-2980-4a97-b37a-ef9cdd854065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:41 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[3945592e-6be6-451f-ad20-f085d50a4605]: (4, 'raw') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-066da2b7-1e6a-4aed-ae52-7372ae31db59 tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:41 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] Volume volume-bd2913b4-48b0-408b-9024-cafd6730edd4 (bd2913b4-48b0-408b-9024-cafd6730edd4): created successfully Apr 10 10:36:41 devstack sudo[86296]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:41 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30640f1f-2980-4a97-b37a-ef9cdd854065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:41 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] Flow 'volume_create_manager' (760d0899-4793-48b5-9538-bdd4fe797739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_najptgt9devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555" returned: 0 in 1.052s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:41 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_najptgt9devstack@QuobyteHD, size 112.00 MB, duration 1.05 sec, destination /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555 {{(pid=81938) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:36:41 devstack cinder-volume[81938]: INFO cinder.image.image_utils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Converted 112.00 MB image at 106.37 MB/s Apr 10 10:36:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:41 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-7115d498-4ce0-406e-acac-d1e4a54a83c9 tempest-AbsoluteLimitsTests-266524859 None] Created volume successfully. Apr 10 10:36:41 devstack sudo[86313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555 1G Apr 10 10:36:41 devstack sudo[86313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:41 devstack sudo[86312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f Apr 10 10:36:41 devstack sudo[86312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:42 devstack sudo[86310]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a51f3926-b4ef-4743-8560-e05bb2a9cc70 tempest-VolumesActionsTest-814240402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4b939da0-c4e6-4291-83ec-2417ac49b944" returned: 0 in 0.521s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a51f3926-b4ef-4743-8560-e05bb2a9cc70 tempest-VolumesActionsTest-814240402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4b939da0-c4e6-4291-83ec-2417ac49b944 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:42 devstack sudo[86322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4b939da0-c4e6-4291-83ec-2417ac49b944 Apr 10 10:36:42 devstack sudo[86322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:42 devstack sudo[86313]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555 1G" returned: 0 in 0.456s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:42 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[616c6312-b3c0-4912-a638-3e8ed950647f]: (4, 'raw') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:42 devstack sudo[86312]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-066da2b7-1e6a-4aed-ae52-7372ae31db59 tempest-VolumesExtendTest-359827302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f" returned: 0 in 0.571s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-066da2b7-1e6a-4aed-ae52-7372ae31db59 tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:42 devstack sudo[86326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555 Apr 10 10:36:42 devstack sudo[86326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:42 devstack sudo[86327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f Apr 10 10:36:42 devstack sudo[86327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:42 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-9c721b6c-fdd5-4e38-946a-4def1e7e131a tempest-AbsoluteLimitsTests-266524859 None] Acquiring lock "cinder-bd2913b4-48b0-408b-9024-cafd6730edd4-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:42 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-9c721b6c-fdd5-4e38-946a-4def1e7e131a tempest-AbsoluteLimitsTests-266524859 None] Lock "cinder-bd2913b4-48b0-408b-9024-cafd6730edd4-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:42 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-9c721b6c-fdd5-4e38-946a-4def1e7e131a tempest-AbsoluteLimitsTests-266524859 None] Acquiring lock "cinder-quobyte-bd2913b4-48b0-408b-9024-cafd6730edd4" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:42 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-9c721b6c-fdd5-4e38-946a-4def1e7e131a tempest-AbsoluteLimitsTests-266524859 None] Lock "cinder-quobyte-bd2913b4-48b0-408b-9024-cafd6730edd4" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:42 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[c127c686-b227-46a4-81ac-5d33371b3e4a]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9c721b6c-fdd5-4e38-946a-4def1e7e131a tempest-AbsoluteLimitsTests-266524859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bd2913b4-48b0-408b-9024-cafd6730edd4 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:42 devstack sudo[86330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bd2913b4-48b0-408b-9024-cafd6730edd4 Apr 10 10:36:42 devstack sudo[86330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:42 devstack sudo[86322]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a51f3926-b4ef-4743-8560-e05bb2a9cc70 tempest-VolumesActionsTest-814240402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4b939da0-c4e6-4291-83ec-2417ac49b944" returned: 0 in 0.505s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:42 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a51f3926-b4ef-4743-8560-e05bb2a9cc70 tempest-VolumesActionsTest-814240402 None] Lock "cinder-quobyte-4b939da0-c4e6-4291-83ec-2417ac49b944" released by "delete_volume" :: held 1.062s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:42 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-a51f3926-b4ef-4743-8560-e05bb2a9cc70 tempest-VolumesActionsTest-814240402 None] Created reservations ['d8daec12-b4dc-4aa7-ae70-df7343026d38', 'f74a3b7e-d53c-487b-8e04-d1493711d2ee', '244042b0-dbf7-401d-a2b3-42fc2c6cf544', '863fd6d4-c041-4a29-99ef-c6c1558afa2a'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a51f3926-b4ef-4743-8560-e05bb2a9cc70 tempest-VolumesActionsTest-814240402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a51f3926-b4ef-4743-8560-e05bb2a9cc70 tempest-VolumesActionsTest-814240402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:42 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a51f3926-b4ef-4743-8560-e05bb2a9cc70 tempest-VolumesActionsTest-814240402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:42 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a51f3926-b4ef-4743-8560-e05bb2a9cc70 tempest-VolumesActionsTest-814240402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a51f3926-b4ef-4743-8560-e05bb2a9cc70 tempest-VolumesActionsTest-814240402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a51f3926-b4ef-4743-8560-e05bb2a9cc70 tempest-VolumesActionsTest-814240402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:42 devstack sudo[86335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:36:42 devstack sudo[86335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:42 devstack sudo[86326]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555" returned: 0 in 0.574s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:43 devstack sudo[86337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555 Apr 10 10:36:43 devstack sudo[86337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:43 devstack sudo[86327]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-066da2b7-1e6a-4aed-ae52-7372ae31db59 tempest-VolumesExtendTest-359827302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f" returned: 1 in 0.652s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-066da2b7-1e6a-4aed-ae52-7372ae31db59 tempest-VolumesExtendTest-359827302 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f' failed. Not Retrying. {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:36:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-066da2b7-1e6a-4aed-ae52-7372ae31db59 tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f 2G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-066da2b7-1e6a-4aed-ae52-7372ae31db59 tempest-VolumesExtendTest-359827302 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f 2G" returned: 0 in 0.075s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-066da2b7-1e6a-4aed-ae52-7372ae31db59 tempest-VolumesExtendTest-359827302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.329s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:43 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-066da2b7-1e6a-4aed-ae52-7372ae31db59 tempest-VolumesExtendTest-359827302 None] Extend volume completed successfully. Apr 10 10:36:43 devstack sudo[86330]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9c721b6c-fdd5-4e38-946a-4def1e7e131a tempest-AbsoluteLimitsTests-266524859 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bd2913b4-48b0-408b-9024-cafd6730edd4" returned: 0 in 0.613s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9c721b6c-fdd5-4e38-946a-4def1e7e131a tempest-AbsoluteLimitsTests-266524859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bd2913b4-48b0-408b-9024-cafd6730edd4 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:43 devstack sudo[86348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bd2913b4-48b0-408b-9024-cafd6730edd4 Apr 10 10:36:43 devstack sudo[86348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:43 devstack sudo[86335]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a51f3926-b4ef-4743-8560-e05bb2a9cc70 tempest-VolumesActionsTest-814240402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.482s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:43 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-a51f3926-b4ef-4743-8560-e05bb2a9cc70 tempest-VolumesActionsTest-814240402 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:43 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-a51f3926-b4ef-4743-8560-e05bb2a9cc70 tempest-VolumesActionsTest-814240402 None] Deleted volume successfully. Apr 10 10:36:43 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a51f3926-b4ef-4743-8560-e05bb2a9cc70 tempest-VolumesActionsTest-814240402 None] Lock "cinder-4b939da0-c4e6-4291-83ec-2417ac49b944-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:43 devstack sudo[86337]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555" returned: 1 in 0.546s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555' failed. Not Retrying. {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:36:43 devstack cinder-volume[81938]: DEBUG cinder.volume.volume_utils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Downloaded image 8dcf7229-52df-43f5-84c5-2e0276bc541d ((None, [{'url': 'file:///opt/stack/data/glance/images/8dcf7229-52df-43f5-84c5-2e0276bc541d', 'metadata': {}}])) to volume 4a6ffd23-af3d-44eb-a387-fb0dcca22555 successfully. {{(pid=81938) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 10 10:36:43 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Temporary image 8dcf7229-52df-43f5-84c5-2e0276bc541d for user 4bdbe981db2e44a88e1ff8fec69fcbf3 is deleted. {{(pid=81938) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 10 10:36:43 devstack cinder-volume[81938]: DEBUG cinder.volume.volume_utils [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Marking volume 4a6ffd23-af3d-44eb-a387-fb0dcca22555 as bootable. {{(pid=81938) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 10 10:36:43 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Copying metadata from image 8dcf7229-52df-43f5-84c5-2e0276bc541d to 4a6ffd23-af3d-44eb-a387-fb0dcca22555. {{(pid=81938) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 10 10:36:43 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Creating volume glance metadata for volume 4a6ffd23-af3d-44eb-a387-fb0dcca22555 backed by image 8dcf7229-52df-43f5-84c5-2e0276bc541d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8dcf7229-52df-43f5-84c5-2e0276bc541d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81938) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 10 10:36:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df86bb4-373c-4752-8e1b-dd314e235e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555', 'volume_size': 1, 'image_id': '8dcf7229-52df-43f5-84c5-2e0276bc541d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf7229-52df-43f5-84c5-2e0276bc541d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '52e7a0ecf90345dca974afb11cfc67b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8dcf7229-52df-43f5-84c5-2e0276bc541d', 'created_at': datetime.datetime(2026, 4, 10, 8, 27, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 27, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dcf7229-52df-43f5-84c5-2e0276bc541d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b19778d-23b5-480e-84d4-ecd28bf63e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:43 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Volume volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555 (4a6ffd23-af3d-44eb-a387-fb0dcca22555): created successfully Apr 10 10:36:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b19778d-23b5-480e-84d4-ecd28bf63e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Flow 'volume_create_manager' (f9844dcb-7c9d-4870-8a0f-26d8ebab3334) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:43 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-90de14ce-273b-4c97-abb2-f636034b3ee0 tempest-VolumesImageMetadata-1514299436 None] Created volume successfully. Apr 10 10:36:43 devstack sudo[86348]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9c721b6c-fdd5-4e38-946a-4def1e7e131a tempest-AbsoluteLimitsTests-266524859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bd2913b4-48b0-408b-9024-cafd6730edd4" returned: 0 in 0.445s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:43 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-9c721b6c-fdd5-4e38-946a-4def1e7e131a tempest-AbsoluteLimitsTests-266524859 None] Lock "cinder-quobyte-bd2913b4-48b0-408b-9024-cafd6730edd4" released by "delete_volume" :: held 1.078s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:43 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-9c721b6c-fdd5-4e38-946a-4def1e7e131a tempest-AbsoluteLimitsTests-266524859 None] Created reservations ['115a2f79-0285-4ae0-ad70-31461e31f86c', 'c6ea062f-6a58-45d6-9c2e-43cbe241802e', '7fe42178-d613-46ee-b783-1bb637acda96', '257a066b-1018-447a-9b5c-837daf888d09'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-9c721b6c-fdd5-4e38-946a-4def1e7e131a tempest-AbsoluteLimitsTests-266524859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-9c721b6c-fdd5-4e38-946a-4def1e7e131a tempest-AbsoluteLimitsTests-266524859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:43 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-9c721b6c-fdd5-4e38-946a-4def1e7e131a tempest-AbsoluteLimitsTests-266524859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:43 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-9c721b6c-fdd5-4e38-946a-4def1e7e131a tempest-AbsoluteLimitsTests-266524859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-9c721b6c-fdd5-4e38-946a-4def1e7e131a tempest-AbsoluteLimitsTests-266524859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9c721b6c-fdd5-4e38-946a-4def1e7e131a tempest-AbsoluteLimitsTests-266524859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:43 devstack sudo[86355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:36:43 devstack sudo[86355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-eefc9934-e7b8-46f4-a2ab-bbaf514ecbf0 tempest-VolumesImageMetadata-1514299436 None] Acquiring lock "cinder-4a6ffd23-af3d-44eb-a387-fb0dcca22555-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] Flow 'volume_create_manager' (8b9e0f9b-8fcf-444d-84f3-05de8eac13ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b016700-0c46-4b0c-a8c2-9cd46ba32b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:44 devstack sudo[86355]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-eefc9934-e7b8-46f4-a2ab-bbaf514ecbf0 tempest-VolumesImageMetadata-1514299436 None] Lock "cinder-4a6ffd23-af3d-44eb-a387-fb0dcca22555-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b016700-0c46-4b0c-a8c2-9cd46ba32b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-582460796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=109575b6-9d69-4755-99a9-e822c3904499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bfccb1031b842f0904bddb7077a4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:44Z,use_quota=True,user_id='efb6a88085154bda891275dfe3fbdc74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea9a1e97-31e9-4249-95da-3cfba5a6a4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea9a1e97-31e9-4249-95da-3cfba5a6a4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (438aa908-2e28-4117-9007-e21a405a3e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (438aa908-2e28-4117-9007-e21a405a3e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '109575b6-9d69-4755-99a9-e822c3904499', 'volume_name': 'volume-109575b6-9d69-4755-99a9-e822c3904499', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14ca3505-6a5e-465d-896a-9acd9e3f013c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14ca3505-6a5e-465d-896a-9acd9e3f013c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e3501f-c14c-41ed-9a65-ef183dd3f0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:44 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] Volume 109575b6-9d69-4755-99a9-e822c3904499: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-109575b6-9d69-4755-99a9-e822c3904499', 'volume_size': 1} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-582460796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=109575b6-9d69-4755-99a9-e822c3904499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bfccb1031b842f0904bddb7077a4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:44Z,use_quota=True,user_id='efb6a88085154bda891275dfe3fbdc74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] Creating volume 109575b6-9d69-4755-99a9-e822c3904499 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:44 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-109575b6-9d69-4755-99a9-e822c3904499 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-afef620f-affe-4934-95f0-c6479fae9769 tempest-VolumesExtendTest-359827302 None] Acquiring lock "cinder-a2ff9505-19ab-4998-80b7-2f24fd358b2f-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:44 devstack sudo[86358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-109575b6-9d69-4755-99a9-e822c3904499 1073741824 Apr 10 10:36:44 devstack sudo[86358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9c721b6c-fdd5-4e38-946a-4def1e7e131a tempest-AbsoluteLimitsTests-266524859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.626s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-9c721b6c-fdd5-4e38-946a-4def1e7e131a tempest-AbsoluteLimitsTests-266524859 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:44 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-9c721b6c-fdd5-4e38-946a-4def1e7e131a tempest-AbsoluteLimitsTests-266524859 None] Deleted volume successfully. Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-eefc9934-e7b8-46f4-a2ab-bbaf514ecbf0 tempest-VolumesImageMetadata-1514299436 None] Acquiring lock "cinder-quobyte-4a6ffd23-af3d-44eb-a387-fb0dcca22555" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-afef620f-affe-4934-95f0-c6479fae9769 tempest-VolumesExtendTest-359827302 None] Lock "cinder-a2ff9505-19ab-4998-80b7-2f24fd358b2f-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-9c721b6c-fdd5-4e38-946a-4def1e7e131a tempest-AbsoluteLimitsTests-266524859 None] Lock "cinder-bd2913b4-48b0-408b-9024-cafd6730edd4-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-eefc9934-e7b8-46f4-a2ab-bbaf514ecbf0 tempest-VolumesImageMetadata-1514299436 None] Lock "cinder-quobyte-4a6ffd23-af3d-44eb-a387-fb0dcca22555" acquired by "delete_volume" :: waited 0.019s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-afef620f-affe-4934-95f0-c6479fae9769 tempest-VolumesExtendTest-359827302 None] Acquiring lock "cinder-quobyte-a2ff9505-19ab-4998-80b7-2f24fd358b2f" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-afef620f-affe-4934-95f0-c6479fae9769 tempest-VolumesExtendTest-359827302 None] Lock "cinder-quobyte-a2ff9505-19ab-4998-80b7-2f24fd358b2f" acquired by "delete_volume" :: waited 0.007s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da8a190-fe05-4634-98c0-d6b137b62715]: (4, 'raw') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-eefc9934-e7b8-46f4-a2ab-bbaf514ecbf0 tempest-VolumesImageMetadata-1514299436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04c0bf0-3b95-421e-949b-d238232f1be4]: (4, 'raw') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-afef620f-affe-4934-95f0-c6479fae9769 tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:44 devstack sudo[86361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555 Apr 10 10:36:44 devstack sudo[86361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:44 devstack sudo[86362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f Apr 10 10:36:44 devstack sudo[86362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:44 devstack sudo[86358]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-109575b6-9d69-4755-99a9-e822c3904499 1073741824" returned: 0 in 0.605s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-109575b6-9d69-4755-99a9-e822c3904499 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:45 devstack sudo[86370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-109575b6-9d69-4755-99a9-e822c3904499 Apr 10 10:36:45 devstack sudo[86370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:45 devstack sudo[86361]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-eefc9934-e7b8-46f4-a2ab-bbaf514ecbf0 tempest-VolumesImageMetadata-1514299436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555" returned: 0 in 0.581s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-eefc9934-e7b8-46f4-a2ab-bbaf514ecbf0 tempest-VolumesImageMetadata-1514299436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:45 devstack sudo[86362]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-afef620f-affe-4934-95f0-c6479fae9769 tempest-VolumesExtendTest-359827302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f" returned: 0 in 0.599s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-afef620f-affe-4934-95f0-c6479fae9769 tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:45 devstack sudo[86375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f Apr 10 10:36:45 devstack sudo[86375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:45 devstack sudo[86374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555 Apr 10 10:36:45 devstack sudo[86374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:45 devstack sudo[86370]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-109575b6-9d69-4755-99a9-e822c3904499" returned: 0 in 0.540s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:45 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e3501f-c14c-41ed-9a65-ef183dd3f0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-109575b6-9d69-4755-99a9-e822c3904499', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eafa6f7-e4d7-4cf3-be8e-cdd8e305ea03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:45 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] Volume volume-109575b6-9d69-4755-99a9-e822c3904499 (109575b6-9d69-4755-99a9-e822c3904499): created successfully Apr 10 10:36:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eafa6f7-e4d7-4cf3-be8e-cdd8e305ea03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] Flow 'volume_create_manager' (8b9e0f9b-8fcf-444d-84f3-05de8eac13ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:45 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-0ab5be2f-bb3f-4e25-92e6-0bc178a244bd tempest-VolumesActionsTest-809678924 None] Created volume successfully. Apr 10 10:36:45 devstack sudo[86374]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-eefc9934-e7b8-46f4-a2ab-bbaf514ecbf0 tempest-VolumesImageMetadata-1514299436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555" returned: 1 in 0.633s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-eefc9934-e7b8-46f4-a2ab-bbaf514ecbf0 tempest-VolumesImageMetadata-1514299436 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555' failed. Not Retrying. {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:36:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-eefc9934-e7b8-46f4-a2ab-bbaf514ecbf0 tempest-VolumesImageMetadata-1514299436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:45 devstack sudo[86385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555 Apr 10 10:36:45 devstack sudo[86385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:45 devstack sudo[86375]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-afef620f-affe-4934-95f0-c6479fae9769 tempest-VolumesExtendTest-359827302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f" returned: 1 in 0.683s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-afef620f-affe-4934-95f0-c6479fae9769 tempest-VolumesExtendTest-359827302 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f' failed. Not Retrying. {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:36:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-afef620f-affe-4934-95f0-c6479fae9769 tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:45 devstack sudo[86387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f Apr 10 10:36:45 devstack sudo[86387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:46 devstack sudo[86385]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-eefc9934-e7b8-46f4-a2ab-bbaf514ecbf0 tempest-VolumesImageMetadata-1514299436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4a6ffd23-af3d-44eb-a387-fb0dcca22555" returned: 0 in 0.460s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:46 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-eefc9934-e7b8-46f4-a2ab-bbaf514ecbf0 tempest-VolumesImageMetadata-1514299436 None] Lock "cinder-quobyte-4a6ffd23-af3d-44eb-a387-fb0dcca22555" released by "delete_volume" :: held 1.719s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:46 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-eefc9934-e7b8-46f4-a2ab-bbaf514ecbf0 tempest-VolumesImageMetadata-1514299436 None] Created reservations ['876e6bc6-b5cf-40f3-94c0-6aa3b220f2a9', '7f71a390-81a2-4da3-81d5-2f1f4aaee476', 'a407f716-97be-4244-8b32-61b55f16bd27', 'fdd134c3-b27c-4b39-b9da-ccecfbd4dd14'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-eefc9934-e7b8-46f4-a2ab-bbaf514ecbf0 tempest-VolumesImageMetadata-1514299436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-eefc9934-e7b8-46f4-a2ab-bbaf514ecbf0 tempest-VolumesImageMetadata-1514299436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:46 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-eefc9934-e7b8-46f4-a2ab-bbaf514ecbf0 tempest-VolumesImageMetadata-1514299436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:46 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-eefc9934-e7b8-46f4-a2ab-bbaf514ecbf0 tempest-VolumesImageMetadata-1514299436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-eefc9934-e7b8-46f4-a2ab-bbaf514ecbf0 tempest-VolumesImageMetadata-1514299436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-eefc9934-e7b8-46f4-a2ab-bbaf514ecbf0 tempest-VolumesImageMetadata-1514299436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:46 devstack sudo[86391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:36:46 devstack sudo[86391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:46 devstack sudo[86387]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-afef620f-affe-4934-95f0-c6479fae9769 tempest-VolumesExtendTest-359827302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a2ff9505-19ab-4998-80b7-2f24fd358b2f" returned: 0 in 0.573s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:46 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-afef620f-affe-4934-95f0-c6479fae9769 tempest-VolumesExtendTest-359827302 None] Lock "cinder-quobyte-a2ff9505-19ab-4998-80b7-2f24fd358b2f" released by "delete_volume" :: held 1.898s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:46 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-afef620f-affe-4934-95f0-c6479fae9769 tempest-VolumesExtendTest-359827302 None] Created reservations ['2afaed78-6f65-4003-a1f7-c96c90cffa17', 'a54a04af-9d9d-4f56-ab3c-cef9aecf8933', 'e25eae0b-40ae-468e-bc13-5aa2d90dba2a', '22fd25c1-d283-4913-a1cf-d544e73f914e'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:46 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-358c072c-f453-49ad-97fd-56e3471a9379 tempest-VolumesActionsTest-814240402 None] Acquiring lock "cinder-109575b6-9d69-4755-99a9-e822c3904499-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:46 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-358c072c-f453-49ad-97fd-56e3471a9379 tempest-VolumesActionsTest-814240402 None] Lock "cinder-109575b6-9d69-4755-99a9-e822c3904499-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-afef620f-affe-4934-95f0-c6479fae9769 tempest-VolumesExtendTest-359827302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-afef620f-affe-4934-95f0-c6479fae9769 tempest-VolumesExtendTest-359827302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:46 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-afef620f-affe-4934-95f0-c6479fae9769 tempest-VolumesExtendTest-359827302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:46 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-afef620f-affe-4934-95f0-c6479fae9769 tempest-VolumesExtendTest-359827302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-afef620f-affe-4934-95f0-c6479fae9769 tempest-VolumesExtendTest-359827302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-afef620f-affe-4934-95f0-c6479fae9769 tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:46 devstack sudo[86393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:36:46 devstack sudo[86393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:46 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-358c072c-f453-49ad-97fd-56e3471a9379 tempest-VolumesActionsTest-814240402 None] Acquiring lock "cinder-quobyte-109575b6-9d69-4755-99a9-e822c3904499" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:46 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-358c072c-f453-49ad-97fd-56e3471a9379 tempest-VolumesActionsTest-814240402 None] Lock "cinder-quobyte-109575b6-9d69-4755-99a9-e822c3904499" acquired by "delete_volume" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:46 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d24805-99d4-4fa6-8743-c1fc490f30fa]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-358c072c-f453-49ad-97fd-56e3471a9379 tempest-VolumesActionsTest-814240402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-109575b6-9d69-4755-99a9-e822c3904499 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:46 devstack sudo[86395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-109575b6-9d69-4755-99a9-e822c3904499 Apr 10 10:36:46 devstack sudo[86395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:47 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] Flow 'volume_create_manager' (77caca3f-1ed8-4050-9ccf-eca54cbf0713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95c6227e-e734-4edc-9cb1-22633cedff0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95c6227e-e734-4edc-9cb1-22633cedff0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-444348081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22db3ad5-feb9-4dc8-b1ec-13578a91070b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7138da017053418585faa1fb4581654a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:47Z,use_quota=True,user_id='1bd37e1347214badaadad54406bb4af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ccdd7f0-07c0-46aa-8bce-38328e6dae51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ccdd7f0-07c0-46aa-8bce-38328e6dae51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a8bca0-8d7a-4742-ab9c-276cbc7b067c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a8bca0-8d7a-4742-ab9c-276cbc7b067c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22db3ad5-feb9-4dc8-b1ec-13578a91070b', 'volume_name': 'volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12824b75-e24a-49df-aff4-d997fe671d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12824b75-e24a-49df-aff4-d997fe671d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d0a10cd-e5ed-457a-9291-12dff51132e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:47 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] Volume 22db3ad5-feb9-4dc8-b1ec-13578a91070b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b', 'volume_size': 1} Apr 10 10:36:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:47 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-444348081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22db3ad5-feb9-4dc8-b1ec-13578a91070b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7138da017053418585faa1fb4581654a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:47Z,use_quota=True,user_id='1bd37e1347214badaadad54406bb4af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:47 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] Creating volume 22db3ad5-feb9-4dc8-b1ec-13578a91070b {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:47 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:47 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:47 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:47 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:36:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:47 devstack sudo[86398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b 1073741824 Apr 10 10:36:47 devstack sudo[86398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:47 devstack sudo[86391]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-eefc9934-e7b8-46f4-a2ab-bbaf514ecbf0 tempest-VolumesImageMetadata-1514299436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.860s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:47 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-eefc9934-e7b8-46f4-a2ab-bbaf514ecbf0 tempest-VolumesImageMetadata-1514299436 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:47 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-eefc9934-e7b8-46f4-a2ab-bbaf514ecbf0 tempest-VolumesImageMetadata-1514299436 None] Deleted volume successfully. Apr 10 10:36:47 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-eefc9934-e7b8-46f4-a2ab-bbaf514ecbf0 tempest-VolumesImageMetadata-1514299436 None] Lock "cinder-4a6ffd23-af3d-44eb-a387-fb0dcca22555-delete_volume" released by "delete_volume" :: held 2.869s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:47 devstack sudo[86393]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-afef620f-affe-4934-95f0-c6479fae9769 tempest-VolumesExtendTest-359827302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.938s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:47 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-afef620f-affe-4934-95f0-c6479fae9769 tempest-VolumesExtendTest-359827302 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:47 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-afef620f-affe-4934-95f0-c6479fae9769 tempest-VolumesExtendTest-359827302 None] Deleted volume successfully. Apr 10 10:36:47 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-afef620f-affe-4934-95f0-c6479fae9769 tempest-VolumesExtendTest-359827302 None] Lock "cinder-a2ff9505-19ab-4998-80b7-2f24fd358b2f-delete_volume" released by "delete_volume" :: held 3.068s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:47 devstack sudo[86395]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-358c072c-f453-49ad-97fd-56e3471a9379 tempest-VolumesActionsTest-814240402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-109575b6-9d69-4755-99a9-e822c3904499" returned: 0 in 0.875s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-358c072c-f453-49ad-97fd-56e3471a9379 tempest-VolumesActionsTest-814240402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-109575b6-9d69-4755-99a9-e822c3904499 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:47 devstack sudo[86404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-109575b6-9d69-4755-99a9-e822c3904499 Apr 10 10:36:47 devstack sudo[86404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:47 devstack sudo[86398]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b 1073741824" returned: 0 in 0.845s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:48 devstack sudo[86409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b Apr 10 10:36:48 devstack sudo[86409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:48 devstack cinder-volume[81938]: DEBUG oslo_service.periodic_task [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81938) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:36:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:48 devstack sudo[86412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:36:48 devstack sudo[86412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:48 devstack sudo[86404]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-358c072c-f453-49ad-97fd-56e3471a9379 tempest-VolumesActionsTest-814240402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-109575b6-9d69-4755-99a9-e822c3904499" returned: 0 in 0.643s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:48 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-358c072c-f453-49ad-97fd-56e3471a9379 tempest-VolumesActionsTest-814240402 None] Lock "cinder-quobyte-109575b6-9d69-4755-99a9-e822c3904499" released by "delete_volume" :: held 1.552s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:48 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-358c072c-f453-49ad-97fd-56e3471a9379 tempest-VolumesActionsTest-814240402 None] Created reservations ['28975a40-cd97-4ac1-80a9-7bc07f05a493', '594a5e97-945b-4d1e-9ad1-529e2237e721', '22570a15-c72d-4c1f-84f4-a5e778967449', '03f1cf02-ff43-43b8-8ef3-7c348c2c2a07'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-358c072c-f453-49ad-97fd-56e3471a9379 tempest-VolumesActionsTest-814240402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-358c072c-f453-49ad-97fd-56e3471a9379 tempest-VolumesActionsTest-814240402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-358c072c-f453-49ad-97fd-56e3471a9379 tempest-VolumesActionsTest-814240402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-358c072c-f453-49ad-97fd-56e3471a9379 tempest-VolumesActionsTest-814240402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-358c072c-f453-49ad-97fd-56e3471a9379 tempest-VolumesActionsTest-814240402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-358c072c-f453-49ad-97fd-56e3471a9379 tempest-VolumesActionsTest-814240402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:48 devstack sudo[86414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:36:48 devstack sudo[86414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:48 devstack sudo[86409]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b" returned: 0 in 0.757s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:48 devstack sudo[86412]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:48 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d0a10cd-e5ed-457a-9291-12dff51132e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:48 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6803d7a2-e5ef-4bf6-9a54-ff63bb5d9a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.725s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:48 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:48 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] Volume volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b (22db3ad5-feb9-4dc8-b1ec-13578a91070b): created successfully Apr 10 10:36:48 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6803d7a2-e5ef-4bf6-9a54-ff63bb5d9a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:48 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] Flow 'volume_create_manager' (77caca3f-1ed8-4050-9ccf-eca54cbf0713) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:48 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-0e5abf26-5b58-4503-84ce-025137ea2a83 tempest-VolumesExtendTest-359827302 None] Created volume successfully. Apr 10 10:36:49 devstack sudo[86414]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-358c072c-f453-49ad-97fd-56e3471a9379 tempest-VolumesActionsTest-814240402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.765s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-358c072c-f453-49ad-97fd-56e3471a9379 tempest-VolumesActionsTest-814240402 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:49 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-358c072c-f453-49ad-97fd-56e3471a9379 tempest-VolumesActionsTest-814240402 None] Deleted volume successfully. Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-358c072c-f453-49ad-97fd-56e3471a9379 tempest-VolumesActionsTest-814240402 None] Lock "cinder-109575b6-9d69-4755-99a9-e822c3904499-delete_volume" released by "delete_volume" :: held 2.633s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] Flow 'volume_create_manager' (b6d8f37d-322c-4e1a-8289-df7846a6718c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da04d37-a1c7-4fce-93dd-f241626ff00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da04d37-a1c7-4fce-93dd-f241626ff00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2010606581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adc4af02-d127-4f87-b641-1b7e20dfe9aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bfccb1031b842f0904bddb7077a4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:49Z,use_quota=True,user_id='efb6a88085154bda891275dfe3fbdc74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b597d94a-fb04-4412-abfc-fcb81be05ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b597d94a-fb04-4412-abfc-fcb81be05ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6deebc4-1863-415a-8597-6fe02972735b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6deebc4-1863-415a-8597-6fe02972735b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adc4af02-d127-4f87-b641-1b7e20dfe9aa', 'volume_name': 'volume-adc4af02-d127-4f87-b641-1b7e20dfe9aa', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b35a3f4a-ab9e-47f0-988a-7f7e4eeada50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b35a3f4a-ab9e-47f0-988a-7f7e4eeada50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc96f63-ea23-4404-94cf-029a63bbb88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:49 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] Volume adc4af02-d127-4f87-b641-1b7e20dfe9aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adc4af02-d127-4f87-b641-1b7e20dfe9aa', 'volume_size': 1} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2010606581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adc4af02-d127-4f87-b641-1b7e20dfe9aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bfccb1031b842f0904bddb7077a4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:49Z,use_quota=True,user_id='efb6a88085154bda891275dfe3fbdc74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] Creating volume adc4af02-d127-4f87-b641-1b7e20dfe9aa {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:49 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-adc4af02-d127-4f87-b641-1b7e20dfe9aa 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:49 devstack sudo[86427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-adc4af02-d127-4f87-b641-1b7e20dfe9aa 1073741824 Apr 10 10:36:49 devstack sudo[86427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] Flow 'volume_create_manager' (12504da4-30dc-40e9-8278-b98bc2f12fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f7eeb2c-4172-4907-84bd-1516fc8aa168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-507e8116-a846-48ea-bf7c-aab2998af883 tempest-VolumesExtendTest-359827302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f7eeb2c-4172-4907-84bd-1516fc8aa168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1095155688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d9c7fe-950f-4669-bece-fe5beca88456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aec538b4298c4581855a204bd803ae77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:49Z,use_quota=True,user_id='cfe232737eeb4fe693a90679cf77b602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a3d6be-8d84-4951-a3aa-71a0c6402bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a3d6be-8d84-4951-a3aa-71a0c6402bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9145d89-f869-4945-acee-9d86fcd92214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9145d89-f869-4945-acee-9d86fcd92214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4d9c7fe-950f-4669-bece-fe5beca88456', 'volume_name': 'volume-b4d9c7fe-950f-4669-bece-fe5beca88456', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (610f815a-081a-4c61-8aeb-0e8797e66cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (610f815a-081a-4c61-8aeb-0e8797e66cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae79970-0b9e-484f-b9d3-c14d228a751e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:49 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] Volume b4d9c7fe-950f-4669-bece-fe5beca88456: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4d9c7fe-950f-4669-bece-fe5beca88456', 'volume_size': 1} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] Flow 'volume_create_manager' (1f862182-5235-4c4a-97bc-5da1bd80285c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e8729a-0d10-4b35-9e3c-a0a78d6c0b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e8729a-0d10-4b35-9e3c-a0a78d6c0b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1047981205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb1baf05-59ce-433a-a9a3-9605008385e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='603fdf514f4445b3ab0d6e4d4e966e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:50Z,use_quota=True,user_id='6e0517102f0b4b1eb0dd53bf1da098d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aec486e-d860-40e9-bdf6-7a8abfff8a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aec486e-d860-40e9-bdf6-7a8abfff8a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71168dce-a189-4ee2-897c-5bca034364c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71168dce-a189-4ee2-897c-5bca034364c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb1baf05-59ce-433a-a9a3-9605008385e6', 'volume_name': 'volume-bb1baf05-59ce-433a-a9a3-9605008385e6', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e063c58-ea46-435b-988e-e5d9a46a1247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e063c58-ea46-435b-988e-e5d9a46a1247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c368ab6-ea13-476e-bb16-3992781b37de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:49 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] Volume bb1baf05-59ce-433a-a9a3-9605008385e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb1baf05-59ce-433a-a9a3-9605008385e6', 'volume_size': 1} Apr 10 10:36:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:50 devstack sudo[86427]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-adc4af02-d127-4f87-b641-1b7e20dfe9aa 1073741824" returned: 0 in 0.592s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-adc4af02-d127-4f87-b641-1b7e20dfe9aa {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:50 devstack sudo[86433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-adc4af02-d127-4f87-b641-1b7e20dfe9aa Apr 10 10:36:50 devstack sudo[86433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:50 devstack sudo[86433]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-adc4af02-d127-4f87-b641-1b7e20dfe9aa" returned: 0 in 0.425s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:50 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-507e8116-a846-48ea-bf7c-aab2998af883 tempest-VolumesExtendTest-359827302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.973s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:50 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-507e8116-a846-48ea-bf7c-aab2998af883 tempest-VolumesExtendTest-359827302 None] Creating offline snapshot 1c949c10-5319-455d-a288-25d7c076d6a9 of volume 22db3ad5-feb9-4dc8-b1ec-13578a91070b {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:36:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc96f63-ea23-4404-94cf-029a63bbb88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adc4af02-d127-4f87-b641-1b7e20dfe9aa', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eccd858f-6621-451c-b739-093f580bf9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:50 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[031eaeaa-2bc8-486f-92b7-6b284d9c31a3]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-507e8116-a846-48ea-bf7c-aab2998af883 tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:50 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] Volume volume-adc4af02-d127-4f87-b641-1b7e20dfe9aa (adc4af02-d127-4f87-b641-1b7e20dfe9aa): created successfully Apr 10 10:36:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eccd858f-6621-451c-b739-093f580bf9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] Flow 'volume_create_manager' (b6d8f37d-322c-4e1a-8289-df7846a6718c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:50 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-33364db7-faf2-46e8-8acf-9d183175d125 tempest-VolumesActionsTest-809678924 None] Created volume successfully. Apr 10 10:36:50 devstack sudo[86436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b Apr 10 10:36:50 devstack sudo[86436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:51 devstack sudo[86436]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-507e8116-a846-48ea-bf7c-aab2998af883 tempest-VolumesExtendTest-359827302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b" returned: 0 in 0.499s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-507e8116-a846-48ea-bf7c-aab2998af883 tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b.1c949c10-5319-455d-a288-25d7c076d6a9 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:51 devstack sudo[86441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b.1c949c10-5319-455d-a288-25d7c076d6a9 1G Apr 10 10:36:51 devstack sudo[86441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:51 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-684a1d8a-1ad9-4779-bd8b-adce09f7170e tempest-VolumesActionsTest-814240402 None] Acquiring lock "cinder-adc4af02-d127-4f87-b641-1b7e20dfe9aa-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:51 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-684a1d8a-1ad9-4779-bd8b-adce09f7170e tempest-VolumesActionsTest-814240402 None] Lock "cinder-adc4af02-d127-4f87-b641-1b7e20dfe9aa-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:51 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-684a1d8a-1ad9-4779-bd8b-adce09f7170e tempest-VolumesActionsTest-814240402 None] Acquiring lock "cinder-quobyte-adc4af02-d127-4f87-b641-1b7e20dfe9aa" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:51 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-684a1d8a-1ad9-4779-bd8b-adce09f7170e tempest-VolumesActionsTest-814240402 None] Lock "cinder-quobyte-adc4af02-d127-4f87-b641-1b7e20dfe9aa" acquired by "delete_volume" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:51 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[c894e31f-4303-4eec-9466-62d6315ca074]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-684a1d8a-1ad9-4779-bd8b-adce09f7170e tempest-VolumesActionsTest-814240402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-adc4af02-d127-4f87-b641-1b7e20dfe9aa {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:51 devstack sudo[86441]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-507e8116-a846-48ea-bf7c-aab2998af883 tempest-VolumesExtendTest-359827302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b.1c949c10-5319-455d-a288-25d7c076d6a9 1G" returned: 0 in 0.639s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-507e8116-a846-48ea-bf7c-aab2998af883 tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b.1c949c10-5319-455d-a288-25d7c076d6a9 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:51 devstack sudo[86447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b.1c949c10-5319-455d-a288-25d7c076d6a9 Apr 10 10:36:51 devstack sudo[86447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:51 devstack sudo[86446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-adc4af02-d127-4f87-b641-1b7e20dfe9aa Apr 10 10:36:51 devstack sudo[86446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:52 devstack sudo[86446]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-684a1d8a-1ad9-4779-bd8b-adce09f7170e tempest-VolumesActionsTest-814240402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-adc4af02-d127-4f87-b641-1b7e20dfe9aa" returned: 0 in 0.617s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-684a1d8a-1ad9-4779-bd8b-adce09f7170e tempest-VolumesActionsTest-814240402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-adc4af02-d127-4f87-b641-1b7e20dfe9aa {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:52 devstack sudo[86457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-adc4af02-d127-4f87-b641-1b7e20dfe9aa Apr 10 10:36:52 devstack sudo[86457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:52 devstack sudo[86447]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-507e8116-a846-48ea-bf7c-aab2998af883 tempest-VolumesExtendTest-359827302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b.1c949c10-5319-455d-a288-25d7c076d6a9" returned: 0 in 0.633s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:52 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-507e8116-a846-48ea-bf7c-aab2998af883 tempest-VolumesExtendTest-359827302 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b.1c949c10-5319-455d-a288-25d7c076d6a9 is being set with open permissions: ugo+rw Apr 10 10:36:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-507e8116-a846-48ea-bf7c-aab2998af883 tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b.1c949c10-5319-455d-a288-25d7c076d6a9 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:52 devstack sudo[86459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b.1c949c10-5319-455d-a288-25d7c076d6a9 Apr 10 10:36:52 devstack sudo[86459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:52 devstack sudo[86459]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-507e8116-a846-48ea-bf7c-aab2998af883 tempest-VolumesExtendTest-359827302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b.1c949c10-5319-455d-a288-25d7c076d6a9" returned: 0 in 0.483s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:52 devstack sudo[86457]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-684a1d8a-1ad9-4779-bd8b-adce09f7170e tempest-VolumesActionsTest-814240402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-adc4af02-d127-4f87-b641-1b7e20dfe9aa" returned: 0 in 0.524s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:52 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-684a1d8a-1ad9-4779-bd8b-adce09f7170e tempest-VolumesActionsTest-814240402 None] Lock "cinder-quobyte-adc4af02-d127-4f87-b641-1b7e20dfe9aa" released by "delete_volume" :: held 1.182s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-507e8116-a846-48ea-bf7c-aab2998af883 tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:52 devstack sudo[86463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b.info Apr 10 10:36:52 devstack sudo[86463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:52 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-684a1d8a-1ad9-4779-bd8b-adce09f7170e tempest-VolumesActionsTest-814240402 None] Created reservations ['d3894a33-f8f6-4a92-856f-92f1fb370e99', '693a399e-3370-4b2e-9af1-8d21b457dbc9', 'abb33e14-6b11-4e8c-930f-f4b8167af412', '6d4abcd8-d174-4863-86ee-617cc16a9944'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-684a1d8a-1ad9-4779-bd8b-adce09f7170e tempest-VolumesActionsTest-814240402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-684a1d8a-1ad9-4779-bd8b-adce09f7170e tempest-VolumesActionsTest-814240402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:52 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-684a1d8a-1ad9-4779-bd8b-adce09f7170e tempest-VolumesActionsTest-814240402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:52 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-684a1d8a-1ad9-4779-bd8b-adce09f7170e tempest-VolumesActionsTest-814240402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-684a1d8a-1ad9-4779-bd8b-adce09f7170e tempest-VolumesActionsTest-814240402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-684a1d8a-1ad9-4779-bd8b-adce09f7170e tempest-VolumesActionsTest-814240402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:52 devstack sudo[86465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:36:52 devstack sudo[86465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:53 devstack sudo[86463]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-507e8116-a846-48ea-bf7c-aab2998af883 tempest-VolumesExtendTest-359827302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b.info" returned: 0 in 0.514s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:53 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-507e8116-a846-48ea-bf7c-aab2998af883 tempest-VolumesExtendTest-359827302 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b.info is being set with open permissions: ugo+rw Apr 10 10:36:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-507e8116-a846-48ea-bf7c-aab2998af883 tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:53 devstack sudo[86468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b.info Apr 10 10:36:53 devstack sudo[86468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:53 devstack sudo[86465]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-684a1d8a-1ad9-4779-bd8b-adce09f7170e tempest-VolumesActionsTest-814240402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.513s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:53 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-684a1d8a-1ad9-4779-bd8b-adce09f7170e tempest-VolumesActionsTest-814240402 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:53 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-684a1d8a-1ad9-4779-bd8b-adce09f7170e tempest-VolumesActionsTest-814240402 None] Deleted volume successfully. Apr 10 10:36:53 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-684a1d8a-1ad9-4779-bd8b-adce09f7170e tempest-VolumesActionsTest-814240402 None] Lock "cinder-adc4af02-d127-4f87-b641-1b7e20dfe9aa-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:53 devstack sudo[86468]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-507e8116-a846-48ea-bf7c-aab2998af883 tempest-VolumesExtendTest-359827302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b.info" returned: 0 in 0.564s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-507e8116-a846-48ea-bf7c-aab2998af883 tempest-VolumesExtendTest-359827302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.423s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.363s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:53 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1095155688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d9c7fe-950f-4669-bece-fe5beca88456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aec538b4298c4581855a204bd803ae77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:49Z,use_quota=True,user_id='cfe232737eeb4fe693a90679cf77b602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:53 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] Creating volume b4d9c7fe-950f-4669-bece-fe5beca88456 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:53 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:53 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:53 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:53 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:36:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:53 devstack sudo[86472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456 1073741824 Apr 10 10:36:53 devstack sudo[86472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:53 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-507e8116-a846-48ea-bf7c-aab2998af883 tempest-VolumesExtendTest-359827302 None] Create snapshot completed successfully Apr 10 10:36:54 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:54 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] Flow 'volume_create_manager' (daef2dfc-92f4-4a43-a7b0-bf50964b4968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:54 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b25f02ac-be96-4aa1-a5d4-bd67aba268ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:54 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b25f02ac-be96-4aa1-a5d4-bd67aba268ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-901491559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b35ebe-571b-41e4-a65e-e1d0da10da1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bfccb1031b842f0904bddb7077a4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:54Z,use_quota=True,user_id='efb6a88085154bda891275dfe3fbdc74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:54 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb0b4bd5-84ed-4e42-84c2-84813732425d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:54 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb0b4bd5-84ed-4e42-84c2-84813732425d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:54 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee522dd-7504-49ac-8146-e28e1fa0cdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:54 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee522dd-7504-49ac-8146-e28e1fa0cdba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83b35ebe-571b-41e4-a65e-e1d0da10da1f', 'volume_name': 'volume-83b35ebe-571b-41e4-a65e-e1d0da10da1f', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:54 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ffbb88-e782-4601-899a-c8cd8bf2f83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:54 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ffbb88-e782-4601-899a-c8cd8bf2f83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:54 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aafa4c49-5778-42f8-a7c0-b754cee9a549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:54 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] Volume 83b35ebe-571b-41e4-a65e-e1d0da10da1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83b35ebe-571b-41e4-a65e-e1d0da10da1f', 'volume_size': 1} Apr 10 10:36:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:54 devstack sudo[86472]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456 1073741824" returned: 0 in 0.583s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:54 devstack sudo[86477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456 Apr 10 10:36:54 devstack sudo[86477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3b1869f4-bd73-4aef-a1dd-3b00c31866f9 tempest-VolumesExtendTest-359827302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:55 devstack sudo[86477]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456" returned: 0 in 0.483s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:55 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.121s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:55 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1047981205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb1baf05-59ce-433a-a9a3-9605008385e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='603fdf514f4445b3ab0d6e4d4e966e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:50Z,use_quota=True,user_id='6e0517102f0b4b1eb0dd53bf1da098d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:55 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] Creating volume bb1baf05-59ce-433a-a9a3-9605008385e6 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:55 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:55 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:55 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:55 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:36:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bb1baf05-59ce-433a-a9a3-9605008385e6 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:55 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae79970-0b9e-484f-b9d3-c14d228a751e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4d9c7fe-950f-4669-bece-fe5beca88456', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:55 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0760b8c-1397-423f-aeee-472d2404576b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:55 devstack sudo[86480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bb1baf05-59ce-433a-a9a3-9605008385e6 1073741824 Apr 10 10:36:55 devstack sudo[86480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:55 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] Volume volume-b4d9c7fe-950f-4669-bece-fe5beca88456 (b4d9c7fe-950f-4669-bece-fe5beca88456): created successfully Apr 10 10:36:55 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0760b8c-1397-423f-aeee-472d2404576b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:55 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] Flow 'volume_create_manager' (12504da4-30dc-40e9-8278-b98bc2f12fbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:55 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-73e870fe-55aa-48bc-9457-81c9c79e7784 tempest-VolumesDeleteCascade-1096754520 None] Created volume successfully. Apr 10 10:36:55 devstack sudo[86480]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bb1baf05-59ce-433a-a9a3-9605008385e6 1073741824" returned: 0 in 0.595s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bb1baf05-59ce-433a-a9a3-9605008385e6 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:55 devstack sudo[86485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bb1baf05-59ce-433a-a9a3-9605008385e6 Apr 10 10:36:55 devstack sudo[86485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f8d40bfb-6ceb-4ef8-b922-1bbe465572e7 tempest-VolumesDeleteCascade-1096754520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:56 devstack sudo[86485]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bb1baf05-59ce-433a-a9a3-9605008385e6" returned: 0 in 0.454s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:56 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.848s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:56 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-901491559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b35ebe-571b-41e4-a65e-e1d0da10da1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bfccb1031b842f0904bddb7077a4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:54Z,use_quota=True,user_id='efb6a88085154bda891275dfe3fbdc74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:56 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] Creating volume 83b35ebe-571b-41e4-a65e-e1d0da10da1f {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:56 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:56 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:56 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:56 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:36:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-83b35ebe-571b-41e4-a65e-e1d0da10da1f 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c368ab6-ea13-476e-bb16-3992781b37de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb1baf05-59ce-433a-a9a3-9605008385e6', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54cd161-850f-4eff-870e-75bb455f4cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:56 devstack sudo[86488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-83b35ebe-571b-41e4-a65e-e1d0da10da1f 1073741824 Apr 10 10:36:56 devstack sudo[86488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:56 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] Volume volume-bb1baf05-59ce-433a-a9a3-9605008385e6 (bb1baf05-59ce-433a-a9a3-9605008385e6): created successfully Apr 10 10:36:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54cd161-850f-4eff-870e-75bb455f4cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] Flow 'volume_create_manager' (1f862182-5235-4c4a-97bc-5da1bd80285c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:56 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-a8f29658-6374-443b-ad81-73921f549a13 tempest-VolumesTransfersTest-1174877101 None] Created volume successfully. Apr 10 10:36:56 devstack sudo[86488]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-83b35ebe-571b-41e4-a65e-e1d0da10da1f 1073741824" returned: 0 in 0.513s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-83b35ebe-571b-41e4-a65e-e1d0da10da1f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:56 devstack sudo[86493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-83b35ebe-571b-41e4-a65e-e1d0da10da1f Apr 10 10:36:56 devstack sudo[86493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:57 devstack sudo[86493]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-83b35ebe-571b-41e4-a65e-e1d0da10da1f" returned: 0 in 0.489s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:57 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3b1869f4-bd73-4aef-a1dd-3b00c31866f9 tempest-VolumesExtendTest-359827302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.485s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:57 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aafa4c49-5778-42f8-a7c0-b754cee9a549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83b35ebe-571b-41e4-a65e-e1d0da10da1f', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:57 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c4af22-a95b-4a29-a516-28db608b3f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:57 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[1463074e-e29c-498d-8ea1-9fc6dd9ec458]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3b1869f4-bd73-4aef-a1dd-3b00c31866f9 tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:57 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] Volume volume-83b35ebe-571b-41e4-a65e-e1d0da10da1f (83b35ebe-571b-41e4-a65e-e1d0da10da1f): created successfully Apr 10 10:36:57 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c4af22-a95b-4a29-a516-28db608b3f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:57 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] Flow 'volume_create_manager' (daef2dfc-92f4-4a43-a7b0-bf50964b4968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:57 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-c2eb5c02-ca95-4970-8bf6-98ee885b88c1 tempest-VolumesActionsTest-809678924 None] Created volume successfully. Apr 10 10:36:57 devstack sudo[86530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b Apr 10 10:36:57 devstack sudo[86530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:57 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7b6c2244-82dd-41cf-b981-4e40d1b52e32 tempest-VolumesActionsTest-814240402 None] Acquiring lock "cinder-83b35ebe-571b-41e4-a65e-e1d0da10da1f-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:57 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7b6c2244-82dd-41cf-b981-4e40d1b52e32 tempest-VolumesActionsTest-814240402 None] Lock "cinder-83b35ebe-571b-41e4-a65e-e1d0da10da1f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:57 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7b6c2244-82dd-41cf-b981-4e40d1b52e32 tempest-VolumesActionsTest-814240402 None] Acquiring lock "cinder-quobyte-83b35ebe-571b-41e4-a65e-e1d0da10da1f" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:57 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7b6c2244-82dd-41cf-b981-4e40d1b52e32 tempest-VolumesActionsTest-814240402 None] Lock "cinder-quobyte-83b35ebe-571b-41e4-a65e-e1d0da10da1f" acquired by "delete_volume" :: waited 0.020s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:57 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb8ddba-94a2-47d4-abca-82fe963ed8a1]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7b6c2244-82dd-41cf-b981-4e40d1b52e32 tempest-VolumesActionsTest-814240402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-83b35ebe-571b-41e4-a65e-e1d0da10da1f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:57 devstack sudo[86532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-83b35ebe-571b-41e4-a65e-e1d0da10da1f Apr 10 10:36:57 devstack sudo[86532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:57 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-292b6973-2c81-4a94-8462-9c2eefe432bc tempest-VolumesTransfersTest-375111935 None] Transfer volume completed successfully. Apr 10 10:36:57 devstack sudo[86530]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3b1869f4-bd73-4aef-a1dd-3b00c31866f9 tempest-VolumesExtendTest-359827302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b" returned: 0 in 0.635s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3b1869f4-bd73-4aef-a1dd-3b00c31866f9 tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b.1c949c10-5319-455d-a288-25d7c076d6a9 2G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3b1869f4-bd73-4aef-a1dd-3b00c31866f9 tempest-VolumesExtendTest-359827302 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b.1c949c10-5319-455d-a288-25d7c076d6a9 2G" returned: 0 in 0.115s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3b1869f4-bd73-4aef-a1dd-3b00c31866f9 tempest-VolumesExtendTest-359827302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.785s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f8d40bfb-6ceb-4ef8-b922-1bbe465572e7 tempest-VolumesDeleteCascade-1096754520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.050s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:57 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-f8d40bfb-6ceb-4ef8-b922-1bbe465572e7 tempest-VolumesDeleteCascade-1096754520 None] Creating offline snapshot c30288ef-a405-454b-8826-fb77e099a389 of volume b4d9c7fe-950f-4669-bece-fe5beca88456 {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:36:57 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[1019f67a-3017-49da-a463-d3ecc3d88724]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f8d40bfb-6ceb-4ef8-b922-1bbe465572e7 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:57 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-3b1869f4-bd73-4aef-a1dd-3b00c31866f9 tempest-VolumesExtendTest-359827302 None] Extend volume completed successfully. Apr 10 10:36:58 devstack sudo[86540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456 Apr 10 10:36:58 devstack sudo[86540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:58 devstack sudo[86532]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7b6c2244-82dd-41cf-b981-4e40d1b52e32 tempest-VolumesActionsTest-814240402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-83b35ebe-571b-41e4-a65e-e1d0da10da1f" returned: 0 in 0.586s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7b6c2244-82dd-41cf-b981-4e40d1b52e32 tempest-VolumesActionsTest-814240402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-83b35ebe-571b-41e4-a65e-e1d0da10da1f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:58 devstack sudo[86545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-83b35ebe-571b-41e4-a65e-e1d0da10da1f Apr 10 10:36:58 devstack sudo[86545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:58 devstack sudo[86540]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f8d40bfb-6ceb-4ef8-b922-1bbe465572e7 tempest-VolumesDeleteCascade-1096754520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456" returned: 0 in 0.591s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f8d40bfb-6ceb-4ef8-b922-1bbe465572e7 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:58 devstack sudo[86551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389 1G Apr 10 10:36:58 devstack sudo[86551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:58 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-0138ac72-17b3-4f23-bd6d-ba827ac8c5a9 tempest-VolumesTransfersTest-26450218 None] Acquiring lock "cinder-bb1baf05-59ce-433a-a9a3-9605008385e6-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:58 devstack sudo[86545]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:58 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-0138ac72-17b3-4f23-bd6d-ba827ac8c5a9 tempest-VolumesTransfersTest-26450218 None] Lock "cinder-bb1baf05-59ce-433a-a9a3-9605008385e6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7b6c2244-82dd-41cf-b981-4e40d1b52e32 tempest-VolumesActionsTest-814240402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-83b35ebe-571b-41e4-a65e-e1d0da10da1f" returned: 0 in 0.572s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:58 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7b6c2244-82dd-41cf-b981-4e40d1b52e32 tempest-VolumesActionsTest-814240402 None] Lock "cinder-quobyte-83b35ebe-571b-41e4-a65e-e1d0da10da1f" released by "delete_volume" :: held 1.183s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:58 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-0138ac72-17b3-4f23-bd6d-ba827ac8c5a9 tempest-VolumesTransfersTest-26450218 None] Acquiring lock "cinder-quobyte-bb1baf05-59ce-433a-a9a3-9605008385e6" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:58 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-0138ac72-17b3-4f23-bd6d-ba827ac8c5a9 tempest-VolumesTransfersTest-26450218 None] Lock "cinder-quobyte-bb1baf05-59ce-433a-a9a3-9605008385e6" acquired by "delete_volume" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:58 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea37ddc0-3af7-4093-9c6a-e35b46995b97]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0138ac72-17b3-4f23-bd6d-ba827ac8c5a9 tempest-VolumesTransfersTest-26450218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bb1baf05-59ce-433a-a9a3-9605008385e6 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:58 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-7b6c2244-82dd-41cf-b981-4e40d1b52e32 tempest-VolumesActionsTest-814240402 None] Created reservations ['c1a75833-280e-4ebc-811c-f5e328842efe', '0e358251-194c-4790-8483-a21712851f48', '99083f56-091f-471f-b090-4930f6ae3c8c', '6b9cde72-a122-4be3-90f5-d2cf0e64199e'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7b6c2244-82dd-41cf-b981-4e40d1b52e32 tempest-VolumesActionsTest-814240402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:58 devstack sudo[86553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bb1baf05-59ce-433a-a9a3-9605008385e6 Apr 10 10:36:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7b6c2244-82dd-41cf-b981-4e40d1b52e32 tempest-VolumesActionsTest-814240402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:58 devstack sudo[86553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:58 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7b6c2244-82dd-41cf-b981-4e40d1b52e32 tempest-VolumesActionsTest-814240402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:58 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7b6c2244-82dd-41cf-b981-4e40d1b52e32 tempest-VolumesActionsTest-814240402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7b6c2244-82dd-41cf-b981-4e40d1b52e32 tempest-VolumesActionsTest-814240402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7b6c2244-82dd-41cf-b981-4e40d1b52e32 tempest-VolumesActionsTest-814240402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:58 devstack sudo[86555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:36:58 devstack sudo[86555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:59 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-503783b0-2858-4f1c-af54-9af50631eb84 tempest-VolumesExtendTest-359827302 None] Acquiring lock "cinder-1c949c10-5319-455d-a288-25d7c076d6a9-delete_snapshot" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:59 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-503783b0-2858-4f1c-af54-9af50631eb84 tempest-VolumesExtendTest-359827302 None] Lock "cinder-1c949c10-5319-455d-a288-25d7c076d6a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:59 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-503783b0-2858-4f1c-af54-9af50631eb84 tempest-VolumesExtendTest-359827302 None] Acquiring lock "cinder-quobyte-22db3ad5-feb9-4dc8-b1ec-13578a91070b" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:59 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-503783b0-2858-4f1c-af54-9af50631eb84 tempest-VolumesExtendTest-359827302 None] Lock "cinder-quobyte-22db3ad5-feb9-4dc8-b1ec-13578a91070b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:59 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-503783b0-2858-4f1c-af54-9af50631eb84 tempest-VolumesExtendTest-359827302 None] Acquiring lock "cinder-quobyte-1c949c10-5319-455d-a288-25d7c076d6a9" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:59 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-503783b0-2858-4f1c-af54-9af50631eb84 tempest-VolumesExtendTest-359827302 None] Lock "cinder-quobyte-1c949c10-5319-455d-a288-25d7c076d6a9" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:59 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-503783b0-2858-4f1c-af54-9af50631eb84 tempest-VolumesExtendTest-359827302 None] Deleting offline snapshot 1c949c10-5319-455d-a288-25d7c076d6a9 of volume 22db3ad5-feb9-4dc8-b1ec-13578a91070b {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:36:59 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-503783b0-2858-4f1c-af54-9af50631eb84 tempest-VolumesExtendTest-359827302 None] snapshot_file for this snap is: volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b.1c949c10-5319-455d-a288-25d7c076d6a9 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:36:59 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3200f63-def9-43cb-a679-5b6f62f158b1]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-503783b0-2858-4f1c-af54-9af50631eb84 tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b.1c949c10-5319-455d-a288-25d7c076d6a9 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:59 devstack sudo[86551]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f8d40bfb-6ceb-4ef8-b922-1bbe465572e7 tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389 1G" returned: 0 in 0.641s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f8d40bfb-6ceb-4ef8-b922-1bbe465572e7 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4d9c7fe-950f-4669-bece-fe5beca88456 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:59 devstack sudo[86561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4d9c7fe-950f-4669-bece-fe5beca88456 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389 Apr 10 10:36:59 devstack sudo[86561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:59 devstack sudo[86560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b.1c949c10-5319-455d-a288-25d7c076d6a9 Apr 10 10:36:59 devstack sudo[86560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:59 devstack sudo[86555]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7b6c2244-82dd-41cf-b981-4e40d1b52e32 tempest-VolumesActionsTest-814240402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.515s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:59 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-7b6c2244-82dd-41cf-b981-4e40d1b52e32 tempest-VolumesActionsTest-814240402 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:59 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-7b6c2244-82dd-41cf-b981-4e40d1b52e32 tempest-VolumesActionsTest-814240402 None] Deleted volume successfully. Apr 10 10:36:59 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7b6c2244-82dd-41cf-b981-4e40d1b52e32 tempest-VolumesActionsTest-814240402 None] Lock "cinder-83b35ebe-571b-41e4-a65e-e1d0da10da1f-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:59 devstack sudo[86553]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0138ac72-17b3-4f23-bd6d-ba827ac8c5a9 tempest-VolumesTransfersTest-26450218 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bb1baf05-59ce-433a-a9a3-9605008385e6" returned: 0 in 0.684s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0138ac72-17b3-4f23-bd6d-ba827ac8c5a9 tempest-VolumesTransfersTest-26450218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bb1baf05-59ce-433a-a9a3-9605008385e6 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:59 devstack sudo[86568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bb1baf05-59ce-433a-a9a3-9605008385e6 Apr 10 10:36:59 devstack sudo[86568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:59 devstack sudo[86560]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-503783b0-2858-4f1c-af54-9af50631eb84 tempest-VolumesExtendTest-359827302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b.1c949c10-5319-455d-a288-25d7c076d6a9" returned: 0 in 0.595s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:59 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-503783b0-2858-4f1c-af54-9af50631eb84 tempest-VolumesExtendTest-359827302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:36:59 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bab89a3-77a0-41eb-a4b9-3e8ab3cf6fe9]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-503783b0-2858-4f1c-af54-9af50631eb84 tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:59 devstack sudo[86561]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f8d40bfb-6ceb-4ef8-b922-1bbe465572e7 tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4d9c7fe-950f-4669-bece-fe5beca88456 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389" returned: 0 in 0.567s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:59 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-f8d40bfb-6ceb-4ef8-b922-1bbe465572e7 tempest-VolumesDeleteCascade-1096754520 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389 is being set with open permissions: ugo+rw Apr 10 10:36:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f8d40bfb-6ceb-4ef8-b922-1bbe465572e7 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:59 devstack sudo[86577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389 Apr 10 10:36:59 devstack sudo[86577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:59 devstack sudo[86576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b Apr 10 10:36:59 devstack sudo[86576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:00 devstack sudo[86568]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0138ac72-17b3-4f23-bd6d-ba827ac8c5a9 tempest-VolumesTransfersTest-26450218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bb1baf05-59ce-433a-a9a3-9605008385e6" returned: 0 in 0.573s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:00 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-0138ac72-17b3-4f23-bd6d-ba827ac8c5a9 tempest-VolumesTransfersTest-26450218 None] Lock "cinder-quobyte-bb1baf05-59ce-433a-a9a3-9605008385e6" released by "delete_volume" :: held 1.298s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:00 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] Flow 'volume_create_manager' (ef9caec0-d149-4f5e-9560-a86fbca98952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf5b07a-c6ac-4498-939d-1c5e8704b5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf5b07a-c6ac-4498-939d-1c5e8704b5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1906320492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fec33c0-ccde-4380-91bd-59c6a2abdb78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bfccb1031b842f0904bddb7077a4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:00Z,use_quota=True,user_id='efb6a88085154bda891275dfe3fbdc74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e4c1592-fa57-46cc-bcc5-645c743fb711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e4c1592-fa57-46cc-bcc5-645c743fb711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cb22a4e-cafb-464b-bad3-a1894bb2ec4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cb22a4e-cafb-464b-bad3-a1894bb2ec4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fec33c0-ccde-4380-91bd-59c6a2abdb78', 'volume_name': 'volume-9fec33c0-ccde-4380-91bd-59c6a2abdb78', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec78f1f-7df2-4a80-a76f-38f7a185580b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec78f1f-7df2-4a80-a76f-38f7a185580b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20fcc8fe-2742-40e1-829a-1cd924ccadd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:00 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] Volume 9fec33c0-ccde-4380-91bd-59c6a2abdb78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fec33c0-ccde-4380-91bd-59c6a2abdb78', 'volume_size': 1} Apr 10 10:37:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:00 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-0138ac72-17b3-4f23-bd6d-ba827ac8c5a9 tempest-VolumesTransfersTest-26450218 None] Created reservations ['c68c7255-3733-43ff-8a95-23f93e8803cd', '9b43599c-b651-4dc5-aae4-976f0c2bf2af', '211c2aa9-34c1-4fb5-b738-839a696d3115', '3525123e-2c22-4e89-8b3a-5fc367dd34b6'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0138ac72-17b3-4f23-bd6d-ba827ac8c5a9 tempest-VolumesTransfersTest-26450218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0138ac72-17b3-4f23-bd6d-ba827ac8c5a9 tempest-VolumesTransfersTest-26450218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:00 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0138ac72-17b3-4f23-bd6d-ba827ac8c5a9 tempest-VolumesTransfersTest-26450218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:00 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0138ac72-17b3-4f23-bd6d-ba827ac8c5a9 tempest-VolumesTransfersTest-26450218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0138ac72-17b3-4f23-bd6d-ba827ac8c5a9 tempest-VolumesTransfersTest-26450218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0138ac72-17b3-4f23-bd6d-ba827ac8c5a9 tempest-VolumesTransfersTest-26450218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:00 devstack sudo[86582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:37:00 devstack sudo[86582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:00 devstack sudo[86577]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f8d40bfb-6ceb-4ef8-b922-1bbe465572e7 tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389" returned: 0 in 0.577s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f8d40bfb-6ceb-4ef8-b922-1bbe465572e7 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:00 devstack sudo[86588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.info Apr 10 10:37:00 devstack sudo[86588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:00 devstack sudo[86576]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-503783b0-2858-4f1c-af54-9af50631eb84 tempest-VolumesExtendTest-359827302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b" returned: 0 in 0.705s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-503783b0-2858-4f1c-af54-9af50631eb84 tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b.1c949c10-5319-455d-a288-25d7c076d6a9 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:00 devstack sudo[86590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b.1c949c10-5319-455d-a288-25d7c076d6a9 Apr 10 10:37:00 devstack sudo[86590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:00 devstack sudo[86582]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0138ac72-17b3-4f23-bd6d-ba827ac8c5a9 tempest-VolumesTransfersTest-26450218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.501s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:00 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-0138ac72-17b3-4f23-bd6d-ba827ac8c5a9 tempest-VolumesTransfersTest-26450218 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:00 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-0138ac72-17b3-4f23-bd6d-ba827ac8c5a9 tempest-VolumesTransfersTest-26450218 None] Deleted volume successfully. Apr 10 10:37:00 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-0138ac72-17b3-4f23-bd6d-ba827ac8c5a9 tempest-VolumesTransfersTest-26450218 None] Lock "cinder-bb1baf05-59ce-433a-a9a3-9605008385e6-delete_volume" released by "delete_volume" :: held 2.081s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:00 devstack sudo[86588]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f8d40bfb-6ceb-4ef8-b922-1bbe465572e7 tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.info" returned: 0 in 0.463s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:00 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-f8d40bfb-6ceb-4ef8-b922-1bbe465572e7 tempest-VolumesDeleteCascade-1096754520 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.info is being set with open permissions: ugo+rw Apr 10 10:37:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f8d40bfb-6ceb-4ef8-b922-1bbe465572e7 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:00 devstack sudo[86594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.info Apr 10 10:37:00 devstack sudo[86594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:01 devstack sudo[86590]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-503783b0-2858-4f1c-af54-9af50631eb84 tempest-VolumesExtendTest-359827302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b.1c949c10-5319-455d-a288-25d7c076d6a9" returned: 0 in 0.619s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-503783b0-2858-4f1c-af54-9af50631eb84 tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b.1c949c10-5319-455d-a288-25d7c076d6a9 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:01 devstack sudo[86599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b.1c949c10-5319-455d-a288-25d7c076d6a9 Apr 10 10:37:01 devstack sudo[86599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] Flow 'volume_create_manager' (e4fe1878-a12f-4e98-a183-fb52a4481ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f2aff6-3ada-4d21-aa81-f85a265d2b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f2aff6-3ada-4d21-aa81-f85a265d2b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1196413760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=963b8932-988f-45bb-bc64-e59584b7103f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='603fdf514f4445b3ab0d6e4d4e966e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:01Z,use_quota=True,user_id='6e0517102f0b4b1eb0dd53bf1da098d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bef9d36e-8672-463f-8e02-20cac0b23fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bef9d36e-8672-463f-8e02-20cac0b23fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f04993f-bb33-4719-999f-38a2e13663ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f04993f-bb33-4719-999f-38a2e13663ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '963b8932-988f-45bb-bc64-e59584b7103f', 'volume_name': 'volume-963b8932-988f-45bb-bc64-e59584b7103f', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f65edb-9bd1-46b5-a26f-4bf90e40238f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f65edb-9bd1-46b5-a26f-4bf90e40238f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6201f8a8-ec1e-4dcb-b16b-7d558dd4e9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:01 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] Volume 963b8932-988f-45bb-bc64-e59584b7103f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-963b8932-988f-45bb-bc64-e59584b7103f', 'volume_size': 1} Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:01 devstack sudo[86594]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f8d40bfb-6ceb-4ef8-b922-1bbe465572e7 tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.info" returned: 0 in 0.575s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f8d40bfb-6ceb-4ef8-b922-1bbe465572e7 tempest-VolumesDeleteCascade-1096754520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.497s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.270s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1906320492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fec33c0-ccde-4380-91bd-59c6a2abdb78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bfccb1031b842f0904bddb7077a4725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:00Z,use_quota=True,user_id='efb6a88085154bda891275dfe3fbdc74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] Creating volume 9fec33c0-ccde-4380-91bd-59c6a2abdb78 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:01 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-9fec33c0-ccde-4380-91bd-59c6a2abdb78 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:01 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-f8d40bfb-6ceb-4ef8-b922-1bbe465572e7 tempest-VolumesDeleteCascade-1096754520 None] Create snapshot completed successfully Apr 10 10:37:01 devstack sudo[86602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-9fec33c0-ccde-4380-91bd-59c6a2abdb78 1073741824 Apr 10 10:37:01 devstack sudo[86602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:01 devstack sudo[86599]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-503783b0-2858-4f1c-af54-9af50631eb84 tempest-VolumesExtendTest-359827302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b.1c949c10-5319-455d-a288-25d7c076d6a9" returned: 0 in 0.530s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-503783b0-2858-4f1c-af54-9af50631eb84 tempest-VolumesExtendTest-359827302 None] Lock "cinder-quobyte-1c949c10-5319-455d-a288-25d7c076d6a9" released by "_delete_snapshot" :: held 2.521s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-503783b0-2858-4f1c-af54-9af50631eb84 tempest-VolumesExtendTest-359827302 None] Lock "cinder-quobyte-22db3ad5-feb9-4dc8-b1ec-13578a91070b" released by "delete_snapshot" :: held 2.535s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-503783b0-2858-4f1c-af54-9af50631eb84 tempest-VolumesExtendTest-359827302 None] Created reservations ['c24b2a8f-293f-4d1a-ace2-506b75d14c55', '9b5c5df4-27b5-4edd-8efa-e6b17ef9d8af', '5f6cd60f-5822-4207-9f68-ef982eafbfe5', '22a243f0-dc10-40bb-abbd-12c7d78fc67c'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:01 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-503783b0-2858-4f1c-af54-9af50631eb84 tempest-VolumesExtendTest-359827302 None] Delete snapshot completed successfully. Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-503783b0-2858-4f1c-af54-9af50631eb84 tempest-VolumesExtendTest-359827302 None] Lock "cinder-1c949c10-5319-455d-a288-25d7c076d6a9-delete_snapshot" released by "delete_snapshot" :: held 2.660s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:01 devstack sudo[86602]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-9fec33c0-ccde-4380-91bd-59c6a2abdb78 1073741824" returned: 0 in 0.538s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-9fec33c0-ccde-4380-91bd-59c6a2abdb78 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:02 devstack sudo[86608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-9fec33c0-ccde-4380-91bd-59c6a2abdb78 Apr 10 10:37:02 devstack sudo[86608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-258be934-22d0-42e8-8c72-7ba72a7dd336 tempest-VolumesDeleteCascade-1096754520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:02 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-186cc10c-bb9c-4207-9c94-7a62c7f6f009 tempest-VolumesExtendTest-359827302 None] Acquiring lock "cinder-22db3ad5-feb9-4dc8-b1ec-13578a91070b-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:02 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-186cc10c-bb9c-4207-9c94-7a62c7f6f009 tempest-VolumesExtendTest-359827302 None] Lock "cinder-22db3ad5-feb9-4dc8-b1ec-13578a91070b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:02 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-186cc10c-bb9c-4207-9c94-7a62c7f6f009 tempest-VolumesExtendTest-359827302 None] Acquiring lock "cinder-quobyte-22db3ad5-feb9-4dc8-b1ec-13578a91070b" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:02 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-186cc10c-bb9c-4207-9c94-7a62c7f6f009 tempest-VolumesExtendTest-359827302 None] Lock "cinder-quobyte-22db3ad5-feb9-4dc8-b1ec-13578a91070b" acquired by "delete_volume" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:02 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3214e90-5071-4bcb-a669-43edf9215a30]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-186cc10c-bb9c-4207-9c94-7a62c7f6f009 tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:02 devstack sudo[86608]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-9fec33c0-ccde-4380-91bd-59c6a2abdb78" returned: 0 in 0.491s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:02 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.185s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:02 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1196413760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=963b8932-988f-45bb-bc64-e59584b7103f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='603fdf514f4445b3ab0d6e4d4e966e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:01Z,use_quota=True,user_id='6e0517102f0b4b1eb0dd53bf1da098d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:02 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] Creating volume 963b8932-988f-45bb-bc64-e59584b7103f {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:02 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:02 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:02 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:02 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:37:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-963b8932-988f-45bb-bc64-e59584b7103f 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:02 devstack sudo[86611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b Apr 10 10:37:02 devstack sudo[86611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:02 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20fcc8fe-2742-40e1-829a-1cd924ccadd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fec33c0-ccde-4380-91bd-59c6a2abdb78', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:02 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39c2cb6f-7509-4ec7-838d-ef977913a9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:02 devstack sudo[86612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-963b8932-988f-45bb-bc64-e59584b7103f 1073741824 Apr 10 10:37:02 devstack sudo[86612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:02 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] Volume volume-9fec33c0-ccde-4380-91bd-59c6a2abdb78 (9fec33c0-ccde-4380-91bd-59c6a2abdb78): created successfully Apr 10 10:37:02 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39c2cb6f-7509-4ec7-838d-ef977913a9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:02 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] Flow 'volume_create_manager' (ef9caec0-d149-4f5e-9560-a86fbca98952) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:02 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-0bf76b4c-a64a-4add-96f5-53a9b0b3354d tempest-VolumesActionsTest-809678924 None] Created volume successfully. Apr 10 10:37:02 devstack sudo[86611]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-186cc10c-bb9c-4207-9c94-7a62c7f6f009 tempest-VolumesExtendTest-359827302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b" returned: 0 in 0.529s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-186cc10c-bb9c-4207-9c94-7a62c7f6f009 tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:02 devstack sudo[86618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b Apr 10 10:37:02 devstack sudo[86618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:03 devstack sudo[86612]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-963b8932-988f-45bb-bc64-e59584b7103f 1073741824" returned: 0 in 0.701s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-963b8932-988f-45bb-bc64-e59584b7103f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:03 devstack sudo[86623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-963b8932-988f-45bb-bc64-e59584b7103f Apr 10 10:37:03 devstack sudo[86623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:03 devstack sudo[86618]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-186cc10c-bb9c-4207-9c94-7a62c7f6f009 tempest-VolumesExtendTest-359827302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-22db3ad5-feb9-4dc8-b1ec-13578a91070b" returned: 0 in 0.509s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:03 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-186cc10c-bb9c-4207-9c94-7a62c7f6f009 tempest-VolumesExtendTest-359827302 None] Lock "cinder-quobyte-22db3ad5-feb9-4dc8-b1ec-13578a91070b" released by "delete_volume" :: held 1.102s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:03 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-186cc10c-bb9c-4207-9c94-7a62c7f6f009 tempest-VolumesExtendTest-359827302 None] Created reservations ['964e9aac-77cb-4dec-9b3d-9333ca29d8cf', '5898759b-7402-41ba-a399-af338ec992df', '4c75a80b-3789-4580-b62a-c9bc8d94e28c', '78ca42f0-9761-4e1e-a679-1963cef1261f'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-186cc10c-bb9c-4207-9c94-7a62c7f6f009 tempest-VolumesExtendTest-359827302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-186cc10c-bb9c-4207-9c94-7a62c7f6f009 tempest-VolumesExtendTest-359827302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:03 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-186cc10c-bb9c-4207-9c94-7a62c7f6f009 tempest-VolumesExtendTest-359827302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:03 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-186cc10c-bb9c-4207-9c94-7a62c7f6f009 tempest-VolumesExtendTest-359827302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-186cc10c-bb9c-4207-9c94-7a62c7f6f009 tempest-VolumesExtendTest-359827302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-186cc10c-bb9c-4207-9c94-7a62c7f6f009 tempest-VolumesExtendTest-359827302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:03 devstack sudo[86626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:37:03 devstack sudo[86626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:03 devstack sudo[86623]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-963b8932-988f-45bb-bc64-e59584b7103f" returned: 0 in 0.596s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:03 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-258be934-22d0-42e8-8c72-7ba72a7dd336 tempest-VolumesDeleteCascade-1096754520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.504s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:03 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6201f8a8-ec1e-4dcb-b16b-7d558dd4e9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-963b8932-988f-45bb-bc64-e59584b7103f', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:03 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d717aedb-28f7-44cf-836e-8b6acf190056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:03 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-258be934-22d0-42e8-8c72-7ba72a7dd336 tempest-VolumesDeleteCascade-1096754520 None] Creating offline snapshot cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42 of volume b4d9c7fe-950f-4669-bece-fe5beca88456 {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:37:03 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-51c5d1f4-ef84-4546-acae-3a2075b45388 tempest-VolumesActionsTest-809678924 None] Acquiring lock "cinder-9fec33c0-ccde-4380-91bd-59c6a2abdb78-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:03 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] Volume volume-963b8932-988f-45bb-bc64-e59584b7103f (963b8932-988f-45bb-bc64-e59584b7103f): created successfully Apr 10 10:37:03 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d717aedb-28f7-44cf-836e-8b6acf190056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:03 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] Flow 'volume_create_manager' (e4fe1878-a12f-4e98-a183-fb52a4481ffb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:03 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0bf79f-7ec5-435c-986c-868d5acf60a5]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-258be934-22d0-42e8-8c72-7ba72a7dd336 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:03 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-51c5d1f4-ef84-4546-acae-3a2075b45388 tempest-VolumesActionsTest-809678924 None] Lock "cinder-9fec33c0-ccde-4380-91bd-59c6a2abdb78-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:03 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-c5cc41f6-6ad5-4f8b-b86c-dcb60edf1915 tempest-VolumesTransfersTest-1174877101 None] Created volume successfully. Apr 10 10:37:03 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-51c5d1f4-ef84-4546-acae-3a2075b45388 tempest-VolumesActionsTest-809678924 None] Acquiring lock "cinder-quobyte-9fec33c0-ccde-4380-91bd-59c6a2abdb78" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:03 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-51c5d1f4-ef84-4546-acae-3a2075b45388 tempest-VolumesActionsTest-809678924 None] Lock "cinder-quobyte-9fec33c0-ccde-4380-91bd-59c6a2abdb78" acquired by "delete_volume" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:03 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[4977cf32-9a93-4b27-baab-63f417bcdf7a]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-51c5d1f4-ef84-4546-acae-3a2075b45388 tempest-VolumesActionsTest-809678924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-9fec33c0-ccde-4380-91bd-59c6a2abdb78 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:04 devstack sudo[86629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389 Apr 10 10:37:04 devstack sudo[86629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:04 devstack sudo[86630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-9fec33c0-ccde-4380-91bd-59c6a2abdb78 Apr 10 10:37:04 devstack sudo[86630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:04 devstack sudo[86626]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-186cc10c-bb9c-4207-9c94-7a62c7f6f009 tempest-VolumesExtendTest-359827302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.476s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:04 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-186cc10c-bb9c-4207-9c94-7a62c7f6f009 tempest-VolumesExtendTest-359827302 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:04 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-186cc10c-bb9c-4207-9c94-7a62c7f6f009 tempest-VolumesExtendTest-359827302 None] Deleted volume successfully. Apr 10 10:37:04 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-186cc10c-bb9c-4207-9c94-7a62c7f6f009 tempest-VolumesExtendTest-359827302 None] Lock "cinder-22db3ad5-feb9-4dc8-b1ec-13578a91070b-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:04 devstack sudo[86629]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-258be934-22d0-42e8-8c72-7ba72a7dd336 tempest-VolumesDeleteCascade-1096754520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389" returned: 0 in 0.615s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:04 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-258be934-22d0-42e8-8c72-7ba72a7dd336 tempest-VolumesDeleteCascade-1096754520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4d9c7fe-950f-4669-bece-fe5beca88456(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:37:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-258be934-22d0-42e8-8c72-7ba72a7dd336 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:04 devstack sudo[86640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42 1G Apr 10 10:37:04 devstack sudo[86640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:04 devstack sudo[86630]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-51c5d1f4-ef84-4546-acae-3a2075b45388 tempest-VolumesActionsTest-809678924 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-9fec33c0-ccde-4380-91bd-59c6a2abdb78" returned: 0 in 0.580s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-51c5d1f4-ef84-4546-acae-3a2075b45388 tempest-VolumesActionsTest-809678924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-9fec33c0-ccde-4380-91bd-59c6a2abdb78 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:04 devstack sudo[86642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-9fec33c0-ccde-4380-91bd-59c6a2abdb78 Apr 10 10:37:04 devstack sudo[86642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:04 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-2e8bf8ac-95f0-4971-b3c9-6eb90fa8d43d tempest-VolumesTransfersTest-26450218 None] Acquiring lock "cinder-963b8932-988f-45bb-bc64-e59584b7103f-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:04 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-2e8bf8ac-95f0-4971-b3c9-6eb90fa8d43d tempest-VolumesTransfersTest-26450218 None] Lock "cinder-963b8932-988f-45bb-bc64-e59584b7103f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:04 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-2e8bf8ac-95f0-4971-b3c9-6eb90fa8d43d tempest-VolumesTransfersTest-26450218 None] Acquiring lock "cinder-quobyte-963b8932-988f-45bb-bc64-e59584b7103f" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:04 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-2e8bf8ac-95f0-4971-b3c9-6eb90fa8d43d tempest-VolumesTransfersTest-26450218 None] Lock "cinder-quobyte-963b8932-988f-45bb-bc64-e59584b7103f" acquired by "delete_volume" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:04 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efc4e13-e034-4494-992f-ebc31b9899e4]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2e8bf8ac-95f0-4971-b3c9-6eb90fa8d43d tempest-VolumesTransfersTest-26450218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-963b8932-988f-45bb-bc64-e59584b7103f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:04 devstack sudo[86644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-963b8932-988f-45bb-bc64-e59584b7103f Apr 10 10:37:04 devstack sudo[86644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:05 devstack sudo[86642]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-51c5d1f4-ef84-4546-acae-3a2075b45388 tempest-VolumesActionsTest-809678924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-9fec33c0-ccde-4380-91bd-59c6a2abdb78" returned: 0 in 0.625s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:05 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-51c5d1f4-ef84-4546-acae-3a2075b45388 tempest-VolumesActionsTest-809678924 None] Lock "cinder-quobyte-9fec33c0-ccde-4380-91bd-59c6a2abdb78" released by "delete_volume" :: held 1.230s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:05 devstack sudo[86640]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-258be934-22d0-42e8-8c72-7ba72a7dd336 tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42 1G" returned: 0 in 0.681s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-258be934-22d0-42e8-8c72-7ba72a7dd336 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:05 devstack sudo[86650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42 Apr 10 10:37:05 devstack sudo[86650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:05 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-51c5d1f4-ef84-4546-acae-3a2075b45388 tempest-VolumesActionsTest-809678924 None] Created reservations ['b686c451-5a84-41c3-9166-fb88f1ee7f40', 'd5e33001-004c-467a-8c66-c4446da696bd', 'f272611e-8dc9-44bc-9576-c9e3b0f782c6', '17114272-0032-429a-bc02-3dca29bab932'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-51c5d1f4-ef84-4546-acae-3a2075b45388 tempest-VolumesActionsTest-809678924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-51c5d1f4-ef84-4546-acae-3a2075b45388 tempest-VolumesActionsTest-809678924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:05 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-51c5d1f4-ef84-4546-acae-3a2075b45388 tempest-VolumesActionsTest-809678924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:05 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-51c5d1f4-ef84-4546-acae-3a2075b45388 tempest-VolumesActionsTest-809678924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-51c5d1f4-ef84-4546-acae-3a2075b45388 tempest-VolumesActionsTest-809678924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-51c5d1f4-ef84-4546-acae-3a2075b45388 tempest-VolumesActionsTest-809678924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:05 devstack sudo[86652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:37:05 devstack sudo[86652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:05 devstack sudo[86644]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2e8bf8ac-95f0-4971-b3c9-6eb90fa8d43d tempest-VolumesTransfersTest-26450218 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-963b8932-988f-45bb-bc64-e59584b7103f" returned: 0 in 0.760s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2e8bf8ac-95f0-4971-b3c9-6eb90fa8d43d tempest-VolumesTransfersTest-26450218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-963b8932-988f-45bb-bc64-e59584b7103f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:05 devstack sudo[86657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-963b8932-988f-45bb-bc64-e59584b7103f Apr 10 10:37:05 devstack sudo[86657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:05 devstack sudo[86650]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-258be934-22d0-42e8-8c72-7ba72a7dd336 tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42" returned: 0 in 0.601s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:05 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-258be934-22d0-42e8-8c72-7ba72a7dd336 tempest-VolumesDeleteCascade-1096754520 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42 is being set with open permissions: ugo+rw Apr 10 10:37:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-258be934-22d0-42e8-8c72-7ba72a7dd336 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:05 devstack sudo[86663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42 Apr 10 10:37:05 devstack sudo[86663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:05 devstack sudo[86652]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-51c5d1f4-ef84-4546-acae-3a2075b45388 tempest-VolumesActionsTest-809678924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.608s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:05 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-51c5d1f4-ef84-4546-acae-3a2075b45388 tempest-VolumesActionsTest-809678924 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:05 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-51c5d1f4-ef84-4546-acae-3a2075b45388 tempest-VolumesActionsTest-809678924 None] Deleted volume successfully. Apr 10 10:37:05 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-51c5d1f4-ef84-4546-acae-3a2075b45388 tempest-VolumesActionsTest-809678924 None] Lock "cinder-9fec33c0-ccde-4380-91bd-59c6a2abdb78-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:06 devstack sudo[86657]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2e8bf8ac-95f0-4971-b3c9-6eb90fa8d43d tempest-VolumesTransfersTest-26450218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-963b8932-988f-45bb-bc64-e59584b7103f" returned: 0 in 0.654s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:06 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-2e8bf8ac-95f0-4971-b3c9-6eb90fa8d43d tempest-VolumesTransfersTest-26450218 None] Lock "cinder-quobyte-963b8932-988f-45bb-bc64-e59584b7103f" released by "delete_volume" :: held 1.436s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:06 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-2e8bf8ac-95f0-4971-b3c9-6eb90fa8d43d tempest-VolumesTransfersTest-26450218 None] Created reservations ['b6d0335a-94c2-4b24-b379-88a4f8431974', 'cc76ed14-b4bb-4c8b-a33d-65e78a2878d4', 'c3ac1376-2e71-4601-b163-2e438a6ba937', 'dd408d43-f884-4ed3-bc18-d8d804be8422'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-2e8bf8ac-95f0-4971-b3c9-6eb90fa8d43d tempest-VolumesTransfersTest-26450218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-2e8bf8ac-95f0-4971-b3c9-6eb90fa8d43d tempest-VolumesTransfersTest-26450218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:06 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-2e8bf8ac-95f0-4971-b3c9-6eb90fa8d43d tempest-VolumesTransfersTest-26450218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:06 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-2e8bf8ac-95f0-4971-b3c9-6eb90fa8d43d tempest-VolumesTransfersTest-26450218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-2e8bf8ac-95f0-4971-b3c9-6eb90fa8d43d tempest-VolumesTransfersTest-26450218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2e8bf8ac-95f0-4971-b3c9-6eb90fa8d43d tempest-VolumesTransfersTest-26450218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:06 devstack sudo[86666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:37:06 devstack sudo[86666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:06 devstack sudo[86663]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-258be934-22d0-42e8-8c72-7ba72a7dd336 tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42" returned: 0 in 0.645s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-258be934-22d0-42e8-8c72-7ba72a7dd336 tempest-VolumesDeleteCascade-1096754520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.656s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:06 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-258be934-22d0-42e8-8c72-7ba72a7dd336 tempest-VolumesDeleteCascade-1096754520 None] Create snapshot completed successfully Apr 10 10:37:06 devstack sudo[86666]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2e8bf8ac-95f0-4971-b3c9-6eb90fa8d43d tempest-VolumesTransfersTest-26450218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.608s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:06 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-2e8bf8ac-95f0-4971-b3c9-6eb90fa8d43d tempest-VolumesTransfersTest-26450218 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:06 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-2e8bf8ac-95f0-4971-b3c9-6eb90fa8d43d tempest-VolumesTransfersTest-26450218 None] Deleted volume successfully. Apr 10 10:37:06 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-2e8bf8ac-95f0-4971-b3c9-6eb90fa8d43d tempest-VolumesTransfersTest-26450218 None] Lock "cinder-963b8932-988f-45bb-bc64-e59584b7103f-delete_volume" released by "delete_volume" :: held 2.243s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] Flow 'volume_create_manager' (a5b9e3ed-7d91-4cfc-9a81-aaf4c6a36a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ace7a1-c884-4223-a2c4-397b8f49288d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ace7a1-c884-4223-a2c4-397b8f49288d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-490036238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2afc0664-4402-4ce0-a141-371e35b8b6c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66e905de71344d9eae2106e4d0d79f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:07Z,use_quota=True,user_id='86da5e0eb0f9470dbbcaea03854ef5e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ff8676-8707-417c-b772-1ceaacd551d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ff8676-8707-417c-b772-1ceaacd551d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87f24fd-98fd-470b-86ce-e11a4edcf4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87f24fd-98fd-470b-86ce-e11a4edcf4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2afc0664-4402-4ce0-a141-371e35b8b6c4', 'volume_name': 'volume-2afc0664-4402-4ce0-a141-371e35b8b6c4', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a727c61-fcf3-4acf-acc1-3b0291e93828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a727c61-fcf3-4acf-acc1-3b0291e93828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e3490ae-a221-4e54-b478-29a32b4c475a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:07 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] Volume 2afc0664-4402-4ce0-a141-371e35b8b6c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2afc0664-4402-4ce0-a141-371e35b8b6c4', 'volume_size': 1} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-490036238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2afc0664-4402-4ce0-a141-371e35b8b6c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66e905de71344d9eae2106e4d0d79f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:07Z,use_quota=True,user_id='86da5e0eb0f9470dbbcaea03854ef5e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] Creating volume 2afc0664-4402-4ce0-a141-371e35b8b6c4 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:07 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2afc0664-4402-4ce0-a141-371e35b8b6c4 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:07 devstack sudo[86670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2afc0664-4402-4ce0-a141-371e35b8b6c4 1073741824 Apr 10 10:37:07 devstack sudo[86670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Acquiring lock "cinder-b4d9c7fe-950f-4669-bece-fe5beca88456-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-b4d9c7fe-950f-4669-bece-fe5beca88456-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Performing cascade delete. {{(pid=81938) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Acquiring lock "cinder-c30288ef-a405-454b-8826-fb77e099a389-delete_snapshot" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-c30288ef-a405-454b-8826-fb77e099a389-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Acquiring lock "cinder-quobyte-b4d9c7fe-950f-4669-bece-fe5beca88456" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-quobyte-b4d9c7fe-950f-4669-bece-fe5beca88456" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Acquiring lock "cinder-quobyte-c30288ef-a405-454b-8826-fb77e099a389" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-quobyte-c30288ef-a405-454b-8826-fb77e099a389" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Deleting offline snapshot c30288ef-a405-454b-8826-fb77e099a389 of volume b4d9c7fe-950f-4669-bece-fe5beca88456 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] snapshot_file for this snap is: volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a1b893-b962-4baf-bbc6-ee5d61f9493f]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:07 devstack sudo[86676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389 Apr 10 10:37:07 devstack sudo[86676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:07 devstack sudo[86670]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2afc0664-4402-4ce0-a141-371e35b8b6c4 1073741824" returned: 0 in 0.804s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2afc0664-4402-4ce0-a141-371e35b8b6c4 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:07 devstack sudo[86678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2afc0664-4402-4ce0-a141-371e35b8b6c4 Apr 10 10:37:07 devstack sudo[86678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:08 devstack sudo[86676]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389" returned: 0 in 0.653s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:08 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4d9c7fe-950f-4669-bece-fe5beca88456(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:37:08 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[490585fa-a194-49c4-8add-f19ddef9a934]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:08 devstack sudo[86684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456 Apr 10 10:37:08 devstack sudo[86684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:08 devstack sudo[86678]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2afc0664-4402-4ce0-a141-371e35b8b6c4" returned: 0 in 0.645s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:08 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:08 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e3490ae-a221-4e54-b478-29a32b4c475a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2afc0664-4402-4ce0-a141-371e35b8b6c4', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:08 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59190c9a-f258-485d-ae5d-9ae3d224c39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:08 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] Volume volume-2afc0664-4402-4ce0-a141-371e35b8b6c4 (2afc0664-4402-4ce0-a141-371e35b8b6c4): created successfully Apr 10 10:37:08 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59190c9a-f258-485d-ae5d-9ae3d224c39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:08 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] Flow 'volume_create_manager' (a5b9e3ed-7d91-4cfc-9a81-aaf4c6a36a0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:08 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-603c1193-69a0-4ed4-a67e-636997848c2e tempest-VolumesNegativeTest-629602989 None] Created volume successfully. Apr 10 10:37:09 devstack sudo[86684]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456" returned: 0 in 0.720s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:09 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cc2b14-cc22-4bdb-ba08-a11727fef21e]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:09 devstack sudo[86690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42 Apr 10 10:37:09 devstack sudo[86690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:10 devstack sudo[86690]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42" returned: 0 in 0.857s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:10 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4d9c7fe-950f-4669-bece-fe5beca88456(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:37:10 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e36fc0a-2cf2-4d8c-8c28-262038e31792]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:10 devstack sudo[86697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389 Apr 10 10:37:10 devstack sudo[86697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:10 devstack sudo[86697]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389" returned: 0 in 0.666s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:10 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4d9c7fe-950f-4669-bece-fe5beca88456(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:37:10 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[11358489-8268-4ca9-a503-a49b65ac7cb7]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:10 devstack sudo[86702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456 Apr 10 10:37:10 devstack sudo[86702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:11 devstack sudo[86702]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456" returned: 0 in 0.606s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:11 devstack sudo[86708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389 Apr 10 10:37:11 devstack sudo[86708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:11 devstack sudo[86708]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389" returned: 0 in 0.602s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:12 devstack sudo[86713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389 Apr 10 10:37:12 devstack sudo[86713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:12 devstack sudo[86713]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.c30288ef-a405-454b-8826-fb77e099a389" returned: 0 in 0.506s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4d9c7fe-950f-4669-bece-fe5beca88456 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42 -F qcow2 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:12 devstack sudo[86717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4d9c7fe-950f-4669-bece-fe5beca88456 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42 -F qcow2 Apr 10 10:37:12 devstack sudo[86717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:13 devstack sudo[86717]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4d9c7fe-950f-4669-bece-fe5beca88456 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42 -F qcow2" returned: 0 in 0.579s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-quobyte-c30288ef-a405-454b-8826-fb77e099a389" released by "_delete_snapshot" :: held 5.332s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-quobyte-b4d9c7fe-950f-4669-bece-fe5beca88456" released by "delete_snapshot" :: held 5.361s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Created reservations ['f5d7b111-5e5c-40f3-a7ed-68ee5a331e77', '145b3464-521b-4852-b47c-2321ae0a1e43', '6a086be7-4025-4de3-a9f6-4b0ad2584cac', '4abaab8f-1510-4e47-b15b-874d2ac44fd0'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] Flow 'volume_create_manager' (fa4819b5-05dd-448b-85ee-7efc8c170080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a468c389-306c-46ef-8e54-26cc775f943f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a468c389-306c-46ef-8e54-26cc775f943f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-255209197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dee7b02a-6f99-4eb9-9a6d-e5c5d4f1ab33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a1d246f6fa24a37aa850533faa9fce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:13Z,use_quota=True,user_id='634fadbc3b874abc94be8b43f23841db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30394e27-847b-4db9-bfa4-7d851d865afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30394e27-847b-4db9-bfa4-7d851d865afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db02efdd-2a02-40d3-b490-12a47b38904c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db02efdd-2a02-40d3-b490-12a47b38904c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dee7b02a-6f99-4eb9-9a6d-e5c5d4f1ab33', 'volume_name': 'volume-dee7b02a-6f99-4eb9-9a6d-e5c5d4f1ab33', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f3ea69-bc34-4d65-be15-44d22ea4f4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f3ea69-bc34-4d65-be15-44d22ea4f4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6edb112e-fcd4-4ef3-80f3-76db8a1d0e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:13 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] Volume dee7b02a-6f99-4eb9-9a6d-e5c5d4f1ab33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dee7b02a-6f99-4eb9-9a6d-e5c5d4f1ab33', 'volume_size': 1} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-255209197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dee7b02a-6f99-4eb9-9a6d-e5c5d4f1ab33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a1d246f6fa24a37aa850533faa9fce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:13Z,use_quota=True,user_id='634fadbc3b874abc94be8b43f23841db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] Creating volume dee7b02a-6f99-4eb9-9a6d-e5c5d4f1ab33 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:13 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dee7b02a-6f99-4eb9-9a6d-e5c5d4f1ab33 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:13 devstack sudo[86723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dee7b02a-6f99-4eb9-9a6d-e5c5d4f1ab33 1073741824 Apr 10 10:37:13 devstack sudo[86723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:13 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Delete snapshot completed successfully. Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-c30288ef-a405-454b-8826-fb77e099a389-delete_snapshot" released by "delete_snapshot" :: held 5.602s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Acquiring lock "cinder-cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42-delete_snapshot" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Acquiring lock "cinder-quobyte-b4d9c7fe-950f-4669-bece-fe5beca88456" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-quobyte-b4d9c7fe-950f-4669-bece-fe5beca88456" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Acquiring lock "cinder-quobyte-cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-quobyte-cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Deleting offline snapshot cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42 of volume b4d9c7fe-950f-4669-bece-fe5beca88456 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] snapshot_file for this snap is: volume-b4d9c7fe-950f-4669-bece-fe5beca88456.cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4243a82-d2c7-46c9-b913-74bb893be1bd]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:13 devstack sudo[86725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42 Apr 10 10:37:13 devstack sudo[86725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:13 devstack sudo[86723]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dee7b02a-6f99-4eb9-9a6d-e5c5d4f1ab33 1073741824" returned: 0 in 0.648s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dee7b02a-6f99-4eb9-9a6d-e5c5d4f1ab33 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:14 devstack sudo[86733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dee7b02a-6f99-4eb9-9a6d-e5c5d4f1ab33 Apr 10 10:37:14 devstack sudo[86733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:14 devstack sudo[86725]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42" returned: 0 in 0.692s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:14 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4d9c7fe-950f-4669-bece-fe5beca88456(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:37:14 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfd361b-a098-4719-84be-63750b2f70af]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:14 devstack sudo[86735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456 Apr 10 10:37:14 devstack sudo[86735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:14 devstack sudo[86733]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dee7b02a-6f99-4eb9-9a6d-e5c5d4f1ab33" returned: 0 in 0.676s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:14 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] <== create_volume: return (1378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:14 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6edb112e-fcd4-4ef3-80f3-76db8a1d0e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dee7b02a-6f99-4eb9-9a6d-e5c5d4f1ab33', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:14 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2010739-945e-49a1-be7f-1c1c7d7d619c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:14 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] Volume volume-dee7b02a-6f99-4eb9-9a6d-e5c5d4f1ab33 (dee7b02a-6f99-4eb9-9a6d-e5c5d4f1ab33): created successfully Apr 10 10:37:14 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2010739-945e-49a1-be7f-1c1c7d7d619c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:14 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] Flow 'volume_create_manager' (fa4819b5-05dd-448b-85ee-7efc8c170080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:14 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-11b42700-5cc5-4ddc-82f6-bca01d7ea3a1 tempest-VolumesTransfersV357Test-121542735 None] Created volume successfully. Apr 10 10:37:14 devstack sudo[86735]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456" returned: 0 in 0.760s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:14 devstack sudo[86741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42 Apr 10 10:37:14 devstack sudo[86741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:15 devstack sudo[86741]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42" returned: 0 in 0.918s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:15 devstack sudo[86746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42 Apr 10 10:37:15 devstack sudo[86746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:16 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-194a57a4-3f6b-48ca-a6a9-06cd0e878ef0 tempest-VolumesTransfersV357Test-132606481 None] Transfer volume completed successfully. Apr 10 10:37:16 devstack sudo[86746]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456.cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42" returned: 0 in 0.631s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:16 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-quobyte-cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42" released by "_delete_snapshot" :: held 3.065s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:16 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-quobyte-b4d9c7fe-950f-4669-bece-fe5beca88456" released by "delete_snapshot" :: held 3.078s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:16 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Created reservations ['913f5562-d419-49e0-9f6a-2202458bc087', '6ebf4e79-4e79-44c0-8ab6-a47f359a0222', 'fe4de60b-a187-45af-bd81-6e7a4f314f42', '5f6334ff-6123-4513-bf12-fdacdc5c9341'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:16 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Delete snapshot completed successfully. Apr 10 10:37:16 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-cdfd97d3-07ed-4d97-af83-b2a2fc4fcd42-delete_snapshot" released by "delete_snapshot" :: held 3.205s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:16 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Snapshots deleted, issuing volume delete {{(pid=81938) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 10 10:37:16 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Acquiring lock "cinder-quobyte-b4d9c7fe-950f-4669-bece-fe5beca88456" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:16 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-quobyte-b4d9c7fe-950f-4669-bece-fe5beca88456" acquired by "delete_volume" :: waited 0.012s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:16 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d5f8f6-5997-418d-bca2-e2f342871328]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:16 devstack sudo[86749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456 Apr 10 10:37:16 devstack sudo[86749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:17 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f5a92929-44ee-4746-bfec-417b9f2bc253 tempest-VolumesTransfersV357Test-2092869133 None] Acquiring lock "cinder-dee7b02a-6f99-4eb9-9a6d-e5c5d4f1ab33-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:17 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f5a92929-44ee-4746-bfec-417b9f2bc253 tempest-VolumesTransfersV357Test-2092869133 None] Lock "cinder-dee7b02a-6f99-4eb9-9a6d-e5c5d4f1ab33-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:17 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f5a92929-44ee-4746-bfec-417b9f2bc253 tempest-VolumesTransfersV357Test-2092869133 None] Acquiring lock "cinder-quobyte-dee7b02a-6f99-4eb9-9a6d-e5c5d4f1ab33" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:17 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f5a92929-44ee-4746-bfec-417b9f2bc253 tempest-VolumesTransfersV357Test-2092869133 None] Lock "cinder-quobyte-dee7b02a-6f99-4eb9-9a6d-e5c5d4f1ab33" acquired by "delete_volume" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:17 devstack sudo[86749]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456" returned: 0 in 0.886s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:17 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf73e7f-5608-461f-a27c-b38ff80d1621]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f5a92929-44ee-4746-bfec-417b9f2bc253 tempest-VolumesTransfersV357Test-2092869133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dee7b02a-6f99-4eb9-9a6d-e5c5d4f1ab33 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:17 devstack sudo[86767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456 Apr 10 10:37:17 devstack sudo[86767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:17 devstack sudo[86769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dee7b02a-6f99-4eb9-9a6d-e5c5d4f1ab33 Apr 10 10:37:17 devstack sudo[86769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:18 devstack sudo[86767]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b4d9c7fe-950f-4669-bece-fe5beca88456" returned: 0 in 0.557s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:18 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-quobyte-b4d9c7fe-950f-4669-bece-fe5beca88456" released by "delete_volume" :: held 1.488s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:18 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writing DB stats cinder:UPDATE=235,cinder:DELETE=22,cinder:SELECT=179,cinder:INSERT=61 {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:37:18 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writing DB stats cinder:SELECT=177,cinder:UPDATE=209,cinder:INSERT=68,cinder:DELETE=16 {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:37:18 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Created reservations ['2aceb812-9094-4912-87f7-e292f56a6ae2', '186b364c-97f9-49d8-8d2e-0cdcca904023', 'dd0fb40c-187a-4447-8dab-97f64e092012', '55c770f9-c110-4bda-94f3-d541e951cd8c'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:18 devstack sudo[86769]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f5a92929-44ee-4746-bfec-417b9f2bc253 tempest-VolumesTransfersV357Test-2092869133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dee7b02a-6f99-4eb9-9a6d-e5c5d4f1ab33" returned: 0 in 0.736s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f5a92929-44ee-4746-bfec-417b9f2bc253 tempest-VolumesTransfersV357Test-2092869133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dee7b02a-6f99-4eb9-9a6d-e5c5d4f1ab33 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:18 devstack sudo[86778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dee7b02a-6f99-4eb9-9a6d-e5c5d4f1ab33 Apr 10 10:37:18 devstack sudo[86778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:18 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:18 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:18 devstack sudo[86780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:37:18 devstack sudo[86780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:18 devstack sudo[86778]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f5a92929-44ee-4746-bfec-417b9f2bc253 tempest-VolumesTransfersV357Test-2092869133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dee7b02a-6f99-4eb9-9a6d-e5c5d4f1ab33" returned: 0 in 0.658s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:18 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f5a92929-44ee-4746-bfec-417b9f2bc253 tempest-VolumesTransfersV357Test-2092869133 None] Lock "cinder-quobyte-dee7b02a-6f99-4eb9-9a6d-e5c5d4f1ab33" released by "delete_volume" :: held 1.437s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-f5a92929-44ee-4746-bfec-417b9f2bc253 tempest-VolumesTransfersV357Test-2092869133 None] Created reservations ['a56dbc74-5810-4d0c-8883-d74bd7fc870d', '3d52b975-5d91-4eab-9213-507cb855daa5', '0652904c-4d6e-455a-b445-f3e6a2a3b6a1', '3bdcbd8d-30fe-46d7-996c-4315bd196bea'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:19 devstack sudo[86780]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.721s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:19 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Deleted volume successfully. Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cc7319e9-98f1-49f2-af3b-cca3ee135740 tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-b4d9c7fe-950f-4669-bece-fe5beca88456-delete_volume" released by "delete_volume" :: held 11.502s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f5a92929-44ee-4746-bfec-417b9f2bc253 tempest-VolumesTransfersV357Test-2092869133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f5a92929-44ee-4746-bfec-417b9f2bc253 tempest-VolumesTransfersV357Test-2092869133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f5a92929-44ee-4746-bfec-417b9f2bc253 tempest-VolumesTransfersV357Test-2092869133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f5a92929-44ee-4746-bfec-417b9f2bc253 tempest-VolumesTransfersV357Test-2092869133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f5a92929-44ee-4746-bfec-417b9f2bc253 tempest-VolumesTransfersV357Test-2092869133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f5a92929-44ee-4746-bfec-417b9f2bc253 tempest-VolumesTransfersV357Test-2092869133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:19 devstack sudo[86784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:37:19 devstack sudo[86784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] Flow 'volume_create_manager' (146827e3-e95c-491f-95db-a06000b5fb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9cc19ae-8baa-4807-bb6f-9918bbae23c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9cc19ae-8baa-4807-bb6f-9918bbae23c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1875084900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7076b57-b66f-4073-b4b7-4fb17db87554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aec538b4298c4581855a204bd803ae77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:19Z,use_quota=True,user_id='cfe232737eeb4fe693a90679cf77b602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6090cd4-f5e2-44a5-ab64-01f5f71cf44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6090cd4-f5e2-44a5-ab64-01f5f71cf44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06e6333f-58a1-48b9-8582-01b72d1fcbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06e6333f-58a1-48b9-8582-01b72d1fcbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7076b57-b66f-4073-b4b7-4fb17db87554', 'volume_name': 'volume-f7076b57-b66f-4073-b4b7-4fb17db87554', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efcee89f-7588-4e7a-b369-9cb243e7f7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efcee89f-7588-4e7a-b369-9cb243e7f7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdca8ffb-f72a-4737-817c-34999be5779c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:19 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] Volume f7076b57-b66f-4073-b4b7-4fb17db87554: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7076b57-b66f-4073-b4b7-4fb17db87554', 'volume_size': 1} Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1875084900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7076b57-b66f-4073-b4b7-4fb17db87554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aec538b4298c4581855a204bd803ae77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:19Z,use_quota=True,user_id='cfe232737eeb4fe693a90679cf77b602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] Creating volume f7076b57-b66f-4073-b4b7-4fb17db87554 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:19 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:19 devstack sudo[86786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554 1073741824 Apr 10 10:37:19 devstack sudo[86786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:19 devstack sudo[86784]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f5a92929-44ee-4746-bfec-417b9f2bc253 tempest-VolumesTransfersV357Test-2092869133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.722s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-f5a92929-44ee-4746-bfec-417b9f2bc253 tempest-VolumesTransfersV357Test-2092869133 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:19 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-f5a92929-44ee-4746-bfec-417b9f2bc253 tempest-VolumesTransfersV357Test-2092869133 None] Deleted volume successfully. Apr 10 10:37:19 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f5a92929-44ee-4746-bfec-417b9f2bc253 tempest-VolumesTransfersV357Test-2092869133 None] Lock "cinder-dee7b02a-6f99-4eb9-9a6d-e5c5d4f1ab33-delete_volume" released by "delete_volume" :: held 2.522s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:20 devstack sudo[86786]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554 1073741824" returned: 0 in 0.759s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:20 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] Flow 'volume_create_manager' (6fa5d327-bf80-4dbd-bd5f-9f3cbc729edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7824e9f1-b281-4b44-a5de-738ca23671f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:20 devstack sudo[86793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554 Apr 10 10:37:20 devstack sudo[86793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7824e9f1-b281-4b44-a5de-738ca23671f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1808770281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=979c9a17-e024-499f-bb9b-9e47b8597710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a1d246f6fa24a37aa850533faa9fce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:20Z,use_quota=True,user_id='634fadbc3b874abc94be8b43f23841db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a8a1abe-1554-42dc-8eee-9e9e0a624b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a8a1abe-1554-42dc-8eee-9e9e0a624b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec2b3a4-781e-4090-87fe-b4a32ec43607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec2b3a4-781e-4090-87fe-b4a32ec43607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '979c9a17-e024-499f-bb9b-9e47b8597710', 'volume_name': 'volume-979c9a17-e024-499f-bb9b-9e47b8597710', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c67e5411-b5b9-437f-808c-d3f17642db5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c67e5411-b5b9-437f-808c-d3f17642db5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fb53a4e-607a-442d-8dde-358d382cac4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:20 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] Volume 979c9a17-e024-499f-bb9b-9e47b8597710: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-979c9a17-e024-499f-bb9b-9e47b8597710', 'volume_size': 1} Apr 10 10:37:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:20 devstack sudo[86793]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554" returned: 0 in 0.540s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:20 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.487s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:20 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1808770281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=979c9a17-e024-499f-bb9b-9e47b8597710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a1d246f6fa24a37aa850533faa9fce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:20Z,use_quota=True,user_id='634fadbc3b874abc94be8b43f23841db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:20 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] Creating volume 979c9a17-e024-499f-bb9b-9e47b8597710 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:20 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:20 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:20 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:20 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:37:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-979c9a17-e024-499f-bb9b-9e47b8597710 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:20 devstack sudo[86796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-979c9a17-e024-499f-bb9b-9e47b8597710 1073741824 Apr 10 10:37:20 devstack sudo[86796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdca8ffb-f72a-4737-817c-34999be5779c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7076b57-b66f-4073-b4b7-4fb17db87554', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4445ac13-3a13-406d-911d-1e3fa5211e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:20 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] Volume volume-f7076b57-b66f-4073-b4b7-4fb17db87554 (f7076b57-b66f-4073-b4b7-4fb17db87554): created successfully Apr 10 10:37:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4445ac13-3a13-406d-911d-1e3fa5211e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] Flow 'volume_create_manager' (146827e3-e95c-491f-95db-a06000b5fb53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:20 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-01fea523-c0de-4a0d-b424-d463fd0fc78d tempest-VolumesDeleteCascade-1096754520 None] Created volume successfully. Apr 10 10:37:21 devstack sudo[86796]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-979c9a17-e024-499f-bb9b-9e47b8597710 1073741824" returned: 0 in 0.674s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-979c9a17-e024-499f-bb9b-9e47b8597710 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:21 devstack sudo[86801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-979c9a17-e024-499f-bb9b-9e47b8597710 Apr 10 10:37:21 devstack sudo[86801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-dcec8bac-6a0b-467e-a143-95bc3ff359eb tempest-VolumesDeleteCascade-1096754520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:21 devstack sudo[86801]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-979c9a17-e024-499f-bb9b-9e47b8597710" returned: 0 in 0.594s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:21 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-dcec8bac-6a0b-467e-a143-95bc3ff359eb tempest-VolumesDeleteCascade-1096754520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.498s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fb53a4e-607a-442d-8dde-358d382cac4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-979c9a17-e024-499f-bb9b-9e47b8597710', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d1fae5-28ce-471e-942d-8c4cbc4212c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-dcec8bac-6a0b-467e-a143-95bc3ff359eb tempest-VolumesDeleteCascade-1096754520 None] Creating offline snapshot c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1 of volume f7076b57-b66f-4073-b4b7-4fb17db87554 {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:37:22 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] Volume volume-979c9a17-e024-499f-bb9b-9e47b8597710 (979c9a17-e024-499f-bb9b-9e47b8597710): created successfully Apr 10 10:37:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d1fae5-28ce-471e-942d-8c4cbc4212c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] Flow 'volume_create_manager' (6fa5d327-bf80-4dbd-bd5f-9f3cbc729edb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:22 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc4987b-6a89-4073-a0c3-d8ec087ec910]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dcec8bac-6a0b-467e-a143-95bc3ff359eb tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:22 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-f708fa69-422c-4781-a50b-da3fe76be316 tempest-VolumesTransfersV357Test-121542735 None] Created volume successfully. Apr 10 10:37:22 devstack sudo[86807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554 Apr 10 10:37:22 devstack sudo[86807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:22 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a6d776a9-b204-4801-a2f7-72e1d4e6b9a6 tempest-VolumesTransfersV357Test-2092869133 None] Acquiring lock "cinder-979c9a17-e024-499f-bb9b-9e47b8597710-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:22 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a6d776a9-b204-4801-a2f7-72e1d4e6b9a6 tempest-VolumesTransfersV357Test-2092869133 None] Lock "cinder-979c9a17-e024-499f-bb9b-9e47b8597710-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:22 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a6d776a9-b204-4801-a2f7-72e1d4e6b9a6 tempest-VolumesTransfersV357Test-2092869133 None] Acquiring lock "cinder-quobyte-979c9a17-e024-499f-bb9b-9e47b8597710" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:22 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a6d776a9-b204-4801-a2f7-72e1d4e6b9a6 tempest-VolumesTransfersV357Test-2092869133 None] Lock "cinder-quobyte-979c9a17-e024-499f-bb9b-9e47b8597710" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:22 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[29462142-98ed-44ee-9190-edd13ef6b1b4]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a6d776a9-b204-4801-a2f7-72e1d4e6b9a6 tempest-VolumesTransfersV357Test-2092869133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-979c9a17-e024-499f-bb9b-9e47b8597710 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:22 devstack sudo[86809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-979c9a17-e024-499f-bb9b-9e47b8597710 Apr 10 10:37:22 devstack sudo[86809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:22 devstack sudo[86807]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dcec8bac-6a0b-467e-a143-95bc3ff359eb tempest-VolumesDeleteCascade-1096754520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554" returned: 0 in 0.791s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dcec8bac-6a0b-467e-a143-95bc3ff359eb tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554.c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:22 devstack sudo[86814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554.c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1 1G Apr 10 10:37:22 devstack sudo[86814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:23 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:23 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] Flow 'volume_create_manager' (8acd2885-0dd6-4624-bb81-e7dc15ad85bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:23 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95642d1-f1f6-40f1-974d-ceb97ff3bd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:23 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95642d1-f1f6-40f1-974d-ceb97ff3bd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-115225488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=152c8d8d-ac56-4e27-9b3a-2104d8bd1cf3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='58215e3461074cdeaa8fa4593af87f2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:23Z,use_quota=True,user_id='97357e798f4741e1aa9faff96c7fc949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:23 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acaa3686-140c-4a1a-87fe-17c4fda411cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:23 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acaa3686-140c-4a1a-87fe-17c4fda411cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:23 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297d6588-e759-4d98-8ba6-ccda544fcef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:23 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297d6588-e759-4d98-8ba6-ccda544fcef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '152c8d8d-ac56-4e27-9b3a-2104d8bd1cf3', 'volume_name': 'volume-152c8d8d-ac56-4e27-9b3a-2104d8bd1cf3', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:23 devstack sudo[86809]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:23 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6e1fd2a-a4b6-4e47-9bad-5f7e9a665210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:23 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6e1fd2a-a4b6-4e47-9bad-5f7e9a665210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:23 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf29f38-7c6d-40fe-9d97-b616cefbd962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:23 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] Volume 152c8d8d-ac56-4e27-9b3a-2104d8bd1cf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-152c8d8d-ac56-4e27-9b3a-2104d8bd1cf3', 'volume_size': 1} Apr 10 10:37:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a6d776a9-b204-4801-a2f7-72e1d4e6b9a6 tempest-VolumesTransfersV357Test-2092869133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-979c9a17-e024-499f-bb9b-9e47b8597710" returned: 0 in 0.824s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a6d776a9-b204-4801-a2f7-72e1d4e6b9a6 tempest-VolumesTransfersV357Test-2092869133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-979c9a17-e024-499f-bb9b-9e47b8597710 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:23 devstack sudo[86843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-979c9a17-e024-499f-bb9b-9e47b8597710 Apr 10 10:37:23 devstack sudo[86843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:23 devstack sudo[86814]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dcec8bac-6a0b-467e-a143-95bc3ff359eb tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554.c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1 1G" returned: 0 in 0.933s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dcec8bac-6a0b-467e-a143-95bc3ff359eb tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7076b57-b66f-4073-b4b7-4fb17db87554 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554.c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:23 devstack sudo[86849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7076b57-b66f-4073-b4b7-4fb17db87554 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554.c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1 Apr 10 10:37:23 devstack sudo[86849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:24 devstack sudo[86843]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a6d776a9-b204-4801-a2f7-72e1d4e6b9a6 tempest-VolumesTransfersV357Test-2092869133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-979c9a17-e024-499f-bb9b-9e47b8597710" returned: 0 in 0.810s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:24 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a6d776a9-b204-4801-a2f7-72e1d4e6b9a6 tempest-VolumesTransfersV357Test-2092869133 None] Lock "cinder-quobyte-979c9a17-e024-499f-bb9b-9e47b8597710" released by "delete_volume" :: held 1.677s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:24 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-a6d776a9-b204-4801-a2f7-72e1d4e6b9a6 tempest-VolumesTransfersV357Test-2092869133 None] Created reservations ['ab8ea280-78fe-46b5-8e6b-fa3f49d8fb8f', 'e05873b9-55cb-4bb4-b8fb-7d869cd96c8b', 'cf49874f-7451-44d4-b64b-44289ae0d55b', 'bbbb8ec8-9c60-4a76-82d4-4a71f9b3d011'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a6d776a9-b204-4801-a2f7-72e1d4e6b9a6 tempest-VolumesTransfersV357Test-2092869133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a6d776a9-b204-4801-a2f7-72e1d4e6b9a6 tempest-VolumesTransfersV357Test-2092869133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:24 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a6d776a9-b204-4801-a2f7-72e1d4e6b9a6 tempest-VolumesTransfersV357Test-2092869133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:24 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a6d776a9-b204-4801-a2f7-72e1d4e6b9a6 tempest-VolumesTransfersV357Test-2092869133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a6d776a9-b204-4801-a2f7-72e1d4e6b9a6 tempest-VolumesTransfersV357Test-2092869133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a6d776a9-b204-4801-a2f7-72e1d4e6b9a6 tempest-VolumesTransfersV357Test-2092869133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:24 devstack sudo[86849]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dcec8bac-6a0b-467e-a143-95bc3ff359eb tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7076b57-b66f-4073-b4b7-4fb17db87554 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554.c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1" returned: 0 in 0.581s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:24 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-dcec8bac-6a0b-467e-a143-95bc3ff359eb tempest-VolumesDeleteCascade-1096754520 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554.c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1 is being set with open permissions: ugo+rw Apr 10 10:37:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dcec8bac-6a0b-467e-a143-95bc3ff359eb tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554.c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:24 devstack sudo[86856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:37:24 devstack sudo[86856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:24 devstack sudo[86858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554.c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1 Apr 10 10:37:24 devstack sudo[86858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:24 devstack sudo[86856]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a6d776a9-b204-4801-a2f7-72e1d4e6b9a6 tempest-VolumesTransfersV357Test-2092869133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.507s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:24 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-a6d776a9-b204-4801-a2f7-72e1d4e6b9a6 tempest-VolumesTransfersV357Test-2092869133 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:24 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-a6d776a9-b204-4801-a2f7-72e1d4e6b9a6 tempest-VolumesTransfersV357Test-2092869133 None] Deleted volume successfully. Apr 10 10:37:24 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a6d776a9-b204-4801-a2f7-72e1d4e6b9a6 tempest-VolumesTransfersV357Test-2092869133 None] Lock "cinder-979c9a17-e024-499f-bb9b-9e47b8597710-delete_volume" released by "delete_volume" :: held 2.398s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:24 devstack sudo[86858]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dcec8bac-6a0b-467e-a143-95bc3ff359eb tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554.c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1" returned: 0 in 0.535s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dcec8bac-6a0b-467e-a143-95bc3ff359eb tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:25 devstack sudo[86862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554.info Apr 10 10:37:25 devstack sudo[86862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:25 devstack sudo[86862]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dcec8bac-6a0b-467e-a143-95bc3ff359eb tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554.info" returned: 0 in 0.650s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:25 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-dcec8bac-6a0b-467e-a143-95bc3ff359eb tempest-VolumesDeleteCascade-1096754520 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554.info is being set with open permissions: ugo+rw Apr 10 10:37:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dcec8bac-6a0b-467e-a143-95bc3ff359eb tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:25 devstack sudo[86865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554.info Apr 10 10:37:25 devstack sudo[86865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:26 devstack sudo[86865]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dcec8bac-6a0b-467e-a143-95bc3ff359eb tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554.info" returned: 0 in 0.492s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-dcec8bac-6a0b-467e-a143-95bc3ff359eb tempest-VolumesDeleteCascade-1096754520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.172s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.776s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:26 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-115225488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=152c8d8d-ac56-4e27-9b3a-2104d8bd1cf3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='58215e3461074cdeaa8fa4593af87f2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:23Z,use_quota=True,user_id='97357e798f4741e1aa9faff96c7fc949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:26 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] Creating volume 152c8d8d-ac56-4e27-9b3a-2104d8bd1cf3 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:26 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:26 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:26 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:26 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:37:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-152c8d8d-ac56-4e27-9b3a-2104d8bd1cf3 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:26 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-dcec8bac-6a0b-467e-a143-95bc3ff359eb tempest-VolumesDeleteCascade-1096754520 None] Create snapshot completed successfully Apr 10 10:37:26 devstack sudo[86868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-152c8d8d-ac56-4e27-9b3a-2104d8bd1cf3 1073741824 Apr 10 10:37:26 devstack sudo[86868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:27 devstack sudo[86868]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-152c8d8d-ac56-4e27-9b3a-2104d8bd1cf3 1073741824" returned: 0 in 1.030s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-152c8d8d-ac56-4e27-9b3a-2104d8bd1cf3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:27 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:27 devstack sudo[86873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-152c8d8d-ac56-4e27-9b3a-2104d8bd1cf3 Apr 10 10:37:27 devstack sudo[86873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Flow 'volume_create_manager' (df9f38c9-5999-4249-b754-1c3ed8e89e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c6ae0d8-35e9-4f17-b98a-29ddbba6f776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c6ae0d8-35e9-4f17-b98a-29ddbba6f776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-365330515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdf55c6f-20ca-461b-ad7d-da9f3ec32e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aec538b4298c4581855a204bd803ae77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:27Z,use_quota=True,user_id='cfe232737eeb4fe693a90679cf77b602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0907b6e-4869-474c-8531-143cc6f5431f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0907b6e-4869-474c-8531-143cc6f5431f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e6f161-8331-4d20-966d-b83b3ea46762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e6f161-8331-4d20-966d-b83b3ea46762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bdf55c6f-20ca-461b-ad7d-da9f3ec32e52', 'volume_name': 'volume-bdf55c6f-20ca-461b-ad7d-da9f3ec32e52', 'volume_size': 1, 'snapshot_id': 'c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1'}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a16e036-c5a6-48fc-9675-569a2ad85e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a16e036-c5a6-48fc-9675-569a2ad85e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a85896-98e1-48e2-a507-a86385032c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:27 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Volume bdf55c6f-20ca-461b-ad7d-da9f3ec32e52: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bdf55c6f-20ca-461b-ad7d-da9f3ec32e52', 'volume_size': 1, 'snapshot_id': 'c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1'} Apr 10 10:37:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:27 devstack sudo[86873]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-152c8d8d-ac56-4e27-9b3a-2104d8bd1cf3" returned: 0 in 0.632s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:27 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.471s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:27 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Acquiring lock "cinder-quobyte-c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1-bdf55c6f-20ca-461b-ad7d-da9f3ec32e52" by "_create_volume_from_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf29f38-7c6d-40fe-9d97-b616cefbd962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-152c8d8d-ac56-4e27-9b3a-2104d8bd1cf3', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b582f8b-d142-4382-87dc-7a5b92631e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:27 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-quobyte-c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1-bdf55c6f-20ca-461b-ad7d-da9f3ec32e52" acquired by "_create_volume_from_snapshot" :: waited 0.049s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:27 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Creating volume bdf55c6f-20ca-461b-ad7d-da9f3ec32e52 from snapshot c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1 {{(pid=81938) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 10:37:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:27 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:27 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:27 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:27 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Acquiring lock "cinder-quobyte-bdf55c6f-20ca-461b-ad7d-da9f3ec32e52" by "_copy_volume_from_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:27 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] Volume volume-152c8d8d-ac56-4e27-9b3a-2104d8bd1cf3 (152c8d8d-ac56-4e27-9b3a-2104d8bd1cf3): created successfully Apr 10 10:37:28 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b582f8b-d142-4382-87dc-7a5b92631e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:28 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] Flow 'volume_create_manager' (8acd2885-0dd6-4624-bb81-e7dc15ad85bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:28 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-quobyte-bdf55c6f-20ca-461b-ad7d-da9f3ec32e52" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:28 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] snapshot: c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1, volume: bdf55c6f-20ca-461b-ad7d-da9f3ec32e52, {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:37:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:28 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:28 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:28 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-d97192c7-caea-4da2-b241-45df74095633 tempest-VolumesListTestJSON-944684155 None] Created volume successfully. Apr 10 10:37:28 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[23741d2a-6271-4f49-bf4b-724fc7b98b0c]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554.c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:28 devstack sudo[86903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554.c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1 Apr 10 10:37:28 devstack sudo[86903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:28 devstack sudo[86903]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554.c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1" returned: 0 in 0.658s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:28 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7076b57-b66f-4073-b4b7-4fb17db87554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:37:28 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554 {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:37:28 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Creating direct copy from snapshot {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:37:28 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8acc7e-c237-4b65-9fe3-b14ae8d6be89]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:28 devstack sudo[86909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554 Apr 10 10:37:28 devstack sudo[86909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:28 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:28 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] Flow 'volume_create_manager' (82d66ee8-19c2-4b7c-8542-5a89aa9a8889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:28 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67fb7920-3b66-4ea8-81fe-84411cd917c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:28 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67fb7920-3b66-4ea8-81fe-84411cd917c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-825252444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2cb72a6-e3d3-4728-955b-8c2ea29425e6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='58215e3461074cdeaa8fa4593af87f2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:29Z,use_quota=True,user_id='97357e798f4741e1aa9faff96c7fc949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:28 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87856ca7-0350-45b0-9687-d170ade7bfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:28 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87856ca7-0350-45b0-9687-d170ade7bfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:28 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51c4c51e-ead0-4dc7-b626-fd5099c7ca76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:28 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51c4c51e-ead0-4dc7-b626-fd5099c7ca76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2cb72a6-e3d3-4728-955b-8c2ea29425e6', 'volume_name': 'volume-f2cb72a6-e3d3-4728-955b-8c2ea29425e6', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:28 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18f0c6b8-e1f1-4c8b-b8df-0493adcbaf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:28 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18f0c6b8-e1f1-4c8b-b8df-0493adcbaf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:28 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4535d1c8-14e2-4210-b3fc-15ac833b2a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:28 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] Volume f2cb72a6-e3d3-4728-955b-8c2ea29425e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2cb72a6-e3d3-4728-955b-8c2ea29425e6', 'volume_size': 1} Apr 10 10:37:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:29 devstack sudo[86909]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554" returned: 0 in 0.619s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:29 devstack cinder-volume[81938]: DEBUG cinder.utils [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Path /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bdf55c6f-20ca-461b-ad7d-da9f3ec32e52 not found in is_blk_device check {{(pid=81938) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:37:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bdf55c6f-20ca-461b-ad7d-da9f3ec32e52 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:29 devstack sudo[86914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bdf55c6f-20ca-461b-ad7d-da9f3ec32e52 Apr 10 10:37:29 devstack sudo[86914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:32 devstack sudo[86914]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bdf55c6f-20ca-461b-ad7d-da9f3ec32e52" returned: 0 in 2.810s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:32 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[b772ce11-f272-4fd4-bc22-7fe581e1c103]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:32 devstack sudo[86930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554 Apr 10 10:37:32 devstack sudo[86930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:32 devstack sudo[86930]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554" returned: 0 in 0.708s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:32 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554, size 1024.00 MB, duration 2.81 sec, destination /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bdf55c6f-20ca-461b-ad7d-da9f3ec32e52 {{(pid=81938) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:37:32 devstack cinder-volume[81938]: INFO cinder.image.image_utils [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Converted 1024.00 MB image at 364.17 MB/s Apr 10 10:37:32 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bdf55c6f-20ca-461b-ad7d-da9f3ec32e52 is being set with open permissions: ugo+rw Apr 10 10:37:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bdf55c6f-20ca-461b-ad7d-da9f3ec32e52 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:32 devstack sudo[86935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bdf55c6f-20ca-461b-ad7d-da9f3ec32e52 Apr 10 10:37:32 devstack sudo[86935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:33 devstack sudo[86935]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bdf55c6f-20ca-461b-ad7d-da9f3ec32e52" returned: 0 in 0.542s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:33 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-quobyte-bdf55c6f-20ca-461b-ad7d-da9f3ec32e52" released by "_copy_volume_from_snapshot" :: held 5.409s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:33 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-quobyte-c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1-bdf55c6f-20ca-461b-ad7d-da9f3ec32e52" released by "_create_volume_from_snapshot" :: held 5.449s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.500s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.449s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:33 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-825252444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2cb72a6-e3d3-4728-955b-8c2ea29425e6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='58215e3461074cdeaa8fa4593af87f2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:29Z,use_quota=True,user_id='97357e798f4741e1aa9faff96c7fc949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:33 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] Creating volume f2cb72a6-e3d3-4728-955b-8c2ea29425e6 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:33 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:33 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:33 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:33 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:37:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f2cb72a6-e3d3-4728-955b-8c2ea29425e6 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a85896-98e1-48e2-a507-a86385032c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdf55c6f-20ca-461b-ad7d-da9f3ec32e52', 'volume_size': 1, 'snapshot_id': 'c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1'}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:33 devstack sudo[86938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f2cb72a6-e3d3-4728-955b-8c2ea29425e6 1073741824 Apr 10 10:37:33 devstack sudo[86938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4887d49-6892-4096-9409-0ec2a1b41ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:33 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Volume volume-bdf55c6f-20ca-461b-ad7d-da9f3ec32e52 (bdf55c6f-20ca-461b-ad7d-da9f3ec32e52): created successfully Apr 10 10:37:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4887d49-6892-4096-9409-0ec2a1b41ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Flow 'volume_create_manager' (df9f38c9-5999-4249-b754-1c3ed8e89e70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:33 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-f17e64e2-18f7-4a70-acfa-f27cefccefe7 tempest-VolumesDeleteCascade-1096754520 None] Created volume successfully. Apr 10 10:37:33 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Acquiring lock "cinder-f7076b57-b66f-4073-b4b7-4fb17db87554-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:34 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-f7076b57-b66f-4073-b4b7-4fb17db87554-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:34 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Performing cascade delete. {{(pid=81938) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 10 10:37:34 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Acquiring lock "cinder-c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1-delete_snapshot" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:34 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:34 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Acquiring lock "cinder-quobyte-f7076b57-b66f-4073-b4b7-4fb17db87554" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:34 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-quobyte-f7076b57-b66f-4073-b4b7-4fb17db87554" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:34 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Acquiring lock "cinder-quobyte-c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:34 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-quobyte-c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:34 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Deleting offline snapshot c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1 of volume f7076b57-b66f-4073-b4b7-4fb17db87554 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:37:34 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] snapshot_file for this snap is: volume-f7076b57-b66f-4073-b4b7-4fb17db87554.c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:37:34 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d09682-b6e5-4655-8dec-f97537ad2e81]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554.c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:34 devstack sudo[86943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554.c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1 Apr 10 10:37:34 devstack sudo[86943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:34 devstack sudo[86938]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f2cb72a6-e3d3-4728-955b-8c2ea29425e6 1073741824" returned: 0 in 0.867s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f2cb72a6-e3d3-4728-955b-8c2ea29425e6 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:34 devstack sudo[86945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f2cb72a6-e3d3-4728-955b-8c2ea29425e6 Apr 10 10:37:34 devstack sudo[86945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:34 devstack sudo[86943]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554.c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1" returned: 0 in 0.647s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:34 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7076b57-b66f-4073-b4b7-4fb17db87554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:37:34 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a565cfd-fd54-4f21-b6c6-22dd85e4333e]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:34 devstack sudo[86945]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f2cb72a6-e3d3-4728-955b-8c2ea29425e6" returned: 0 in 0.538s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:34 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:34 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4535d1c8-14e2-4210-b3fc-15ac833b2a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2cb72a6-e3d3-4728-955b-8c2ea29425e6', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:34 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd53657a-4b1f-4d87-8362-d10017559b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:34 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] Volume volume-f2cb72a6-e3d3-4728-955b-8c2ea29425e6 (f2cb72a6-e3d3-4728-955b-8c2ea29425e6): created successfully Apr 10 10:37:34 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd53657a-4b1f-4d87-8362-d10017559b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:34 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] Flow 'volume_create_manager' (82d66ee8-19c2-4b7c-8542-5a89aa9a8889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:34 devstack sudo[86951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554 Apr 10 10:37:34 devstack sudo[86951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:34 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-8ab31a09-558a-4e06-b630-92c50e016411 tempest-VolumesListTestJSON-944684155 None] Created volume successfully. Apr 10 10:37:35 devstack sudo[86951]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554" returned: 0 in 0.671s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554.c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:35 devstack sudo[86957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554.c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1 Apr 10 10:37:35 devstack sudo[86957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:35 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] Flow 'volume_create_manager' (b74a085a-d0f1-4694-9ab3-a574e9b72d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51de1412-4b55-40e7-97a7-e3820698bdc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51de1412-4b55-40e7-97a7-e3820698bdc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-260473775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7abd2413-47f7-472b-9cc6-4dd292ae7887,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='58215e3461074cdeaa8fa4593af87f2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:36Z,use_quota=True,user_id='97357e798f4741e1aa9faff96c7fc949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a37099-e5c4-4238-b11c-4f0733a73870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a37099-e5c4-4238-b11c-4f0733a73870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fae4c3c-3ff2-4685-a9bc-77693692c1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fae4c3c-3ff2-4685-a9bc-77693692c1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7abd2413-47f7-472b-9cc6-4dd292ae7887', 'volume_name': 'volume-7abd2413-47f7-472b-9cc6-4dd292ae7887', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be22132-9fc9-4c1c-8f44-a08c7ed1ff99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be22132-9fc9-4c1c-8f44-a08c7ed1ff99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00d5a27b-cc8d-4113-9bb2-45d78606897e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:36 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] Volume 7abd2413-47f7-472b-9cc6-4dd292ae7887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7abd2413-47f7-472b-9cc6-4dd292ae7887', 'volume_size': 1} Apr 10 10:37:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:36 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-260473775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7abd2413-47f7-472b-9cc6-4dd292ae7887,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='58215e3461074cdeaa8fa4593af87f2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:36Z,use_quota=True,user_id='97357e798f4741e1aa9faff96c7fc949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:36 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] Creating volume 7abd2413-47f7-472b-9cc6-4dd292ae7887 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:36 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:36 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:36 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:36 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:37:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7abd2413-47f7-472b-9cc6-4dd292ae7887 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:36 devstack sudo[86963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7abd2413-47f7-472b-9cc6-4dd292ae7887 1073741824 Apr 10 10:37:36 devstack sudo[86963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:36 devstack sudo[86957]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554.c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1" returned: 0 in 0.704s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554.c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:36 devstack sudo[86965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554.c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1 Apr 10 10:37:36 devstack sudo[86965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:36 devstack sudo[86963]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7abd2413-47f7-472b-9cc6-4dd292ae7887 1073741824" returned: 0 in 0.821s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7abd2413-47f7-472b-9cc6-4dd292ae7887 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:36 devstack sudo[86971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7abd2413-47f7-472b-9cc6-4dd292ae7887 Apr 10 10:37:36 devstack sudo[86971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:37 devstack sudo[86965]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554.c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1" returned: 0 in 0.811s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:37 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-quobyte-c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1" released by "_delete_snapshot" :: held 2.905s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:37 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-quobyte-f7076b57-b66f-4073-b4b7-4fb17db87554" released by "delete_snapshot" :: held 2.928s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:37 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Created reservations ['51208989-3a81-4aee-bec6-c874c0d0130e', '94b66a3e-1a7a-4e81-8a46-bb2f702b715f', 'd893dd66-4a56-4f58-88f4-220db03b21b7', '7647ed89-1974-470b-8ba4-b01480aa5a2c'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:37 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Delete snapshot completed successfully. Apr 10 10:37:37 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-c6a628e8-62e7-4cd4-9bc1-994f2f5b60a1-delete_snapshot" released by "delete_snapshot" :: held 3.135s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:37 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Snapshots deleted, issuing volume delete {{(pid=81938) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 10 10:37:37 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Acquiring lock "cinder-quobyte-f7076b57-b66f-4073-b4b7-4fb17db87554" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:37 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-quobyte-f7076b57-b66f-4073-b4b7-4fb17db87554" acquired by "delete_volume" :: waited 0.012s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:37 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[68910aa2-0381-4f54-b782-ac3ebc0f892a]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:37 devstack sudo[86973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554 Apr 10 10:37:37 devstack sudo[86973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:37 devstack sudo[86971]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7abd2413-47f7-472b-9cc6-4dd292ae7887" returned: 0 in 0.700s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:37 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:37 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00d5a27b-cc8d-4113-9bb2-45d78606897e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7abd2413-47f7-472b-9cc6-4dd292ae7887', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:37 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4970db0e-a1b4-4ab9-ab96-b8815f6a5f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:37 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] Volume volume-7abd2413-47f7-472b-9cc6-4dd292ae7887 (7abd2413-47f7-472b-9cc6-4dd292ae7887): created successfully Apr 10 10:37:37 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4970db0e-a1b4-4ab9-ab96-b8815f6a5f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:37 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] Flow 'volume_create_manager' (b74a085a-d0f1-4694-9ab3-a574e9b72d86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:37 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-b6694612-b9b7-4780-b4ff-b1de6a48c279 tempest-VolumesListTestJSON-944684155 None] Created volume successfully. Apr 10 10:37:38 devstack sudo[86973]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554" returned: 0 in 0.833s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:38 devstack sudo[86979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554 Apr 10 10:37:38 devstack sudo[86979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:38 devstack sudo[86979]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f7076b57-b66f-4073-b4b7-4fb17db87554" returned: 0 in 0.680s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:38 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-quobyte-f7076b57-b66f-4073-b4b7-4fb17db87554" released by "delete_volume" :: held 1.558s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:38 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Created reservations ['48305f0d-925e-4f6c-82dd-335249181ccb', 'a63ce0d7-7f05-40b3-8905-f058001d333a', '20c1abd6-094a-4786-a875-85ef31968d47', '5671f5f4-af5b-46e8-9410-74224bd4f996'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:38 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:38 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:39 devstack sudo[86982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:37:39 devstack sudo[86982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:39 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-d2e675cb-4799-4b87-ae2a-b8e9b93f249b tempest-VolumesNegativeTest-629602989 None] Acquiring lock "cinder-2afc0664-4402-4ce0-a141-371e35b8b6c4-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:39 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-d2e675cb-4799-4b87-ae2a-b8e9b93f249b tempest-VolumesNegativeTest-629602989 None] Lock "cinder-2afc0664-4402-4ce0-a141-371e35b8b6c4-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:39 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-d2e675cb-4799-4b87-ae2a-b8e9b93f249b tempest-VolumesNegativeTest-629602989 None] Acquiring lock "cinder-quobyte-2afc0664-4402-4ce0-a141-371e35b8b6c4" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:39 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-d2e675cb-4799-4b87-ae2a-b8e9b93f249b tempest-VolumesNegativeTest-629602989 None] Lock "cinder-quobyte-2afc0664-4402-4ce0-a141-371e35b8b6c4" acquired by "delete_volume" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:39 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[813a1504-200a-47ce-8e9e-eaf8ea13c78b]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d2e675cb-4799-4b87-ae2a-b8e9b93f249b tempest-VolumesNegativeTest-629602989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2afc0664-4402-4ce0-a141-371e35b8b6c4 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:39 devstack sudo[86985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2afc0664-4402-4ce0-a141-371e35b8b6c4 Apr 10 10:37:39 devstack sudo[86985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:39 devstack sudo[86982]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.745s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:39 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:39 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Deleted volume successfully. Apr 10 10:37:39 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c0e70e23-c2bd-40bd-b7e4-1afe57d9355a tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-f7076b57-b66f-4073-b4b7-4fb17db87554-delete_volume" released by "delete_volume" :: held 5.730s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:39 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-46511750-b54f-4e05-8c13-36189b54dff9 tempest-VolumesDeleteCascade-1096754520 None] Acquiring lock "cinder-bdf55c6f-20ca-461b-ad7d-da9f3ec32e52-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:39 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-46511750-b54f-4e05-8c13-36189b54dff9 tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-bdf55c6f-20ca-461b-ad7d-da9f3ec32e52-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:39 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-46511750-b54f-4e05-8c13-36189b54dff9 tempest-VolumesDeleteCascade-1096754520 None] Acquiring lock "cinder-quobyte-bdf55c6f-20ca-461b-ad7d-da9f3ec32e52" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:39 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-46511750-b54f-4e05-8c13-36189b54dff9 tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-quobyte-bdf55c6f-20ca-461b-ad7d-da9f3ec32e52" acquired by "delete_volume" :: waited 0.023s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:39 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3446dc0-19cb-435d-b7b9-b9b836d13589]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-46511750-b54f-4e05-8c13-36189b54dff9 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bdf55c6f-20ca-461b-ad7d-da9f3ec32e52 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] Flow 'volume_create_manager' (81b81e91-ee48-449c-b7c7-0f6f513b494a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cf62fd7-8d18-4692-b8c2-295e0d6ae999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cf62fd7-8d18-4692-b8c2-295e0d6ae999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2020690496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae0d6d50b76495fa2dc9cd2c92460c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:40Z,use_quota=True,user_id='d9b52798d60d40c481d492e666535de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c2b9a06-b09b-4e21-b5b0-bb14ae63f863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c2b9a06-b09b-4e21-b5b0-bb14ae63f863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a36880-5e27-46c8-92ff-9c21b4c9d8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a36880-5e27-46c8-92ff-9c21b4c9d8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f', 'volume_name': 'volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4d851f5-4d18-4a0f-ad6f-0b880a871e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:40 devstack sudo[86988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bdf55c6f-20ca-461b-ad7d-da9f3ec32e52 Apr 10 10:37:40 devstack sudo[86988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4d851f5-4d18-4a0f-ad6f-0b880a871e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70978515-cc0a-43fa-ac79-0f3a7dfcabc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:40 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] Volume b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f', 'volume_size': 1} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2020690496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae0d6d50b76495fa2dc9cd2c92460c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:40Z,use_quota=True,user_id='d9b52798d60d40c481d492e666535de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] Creating volume b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:40 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:40 devstack sudo[86991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f 1073741824 Apr 10 10:37:40 devstack sudo[86991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:40 devstack sudo[86985]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d2e675cb-4799-4b87-ae2a-b8e9b93f249b tempest-VolumesNegativeTest-629602989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2afc0664-4402-4ce0-a141-371e35b8b6c4" returned: 0 in 0.669s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d2e675cb-4799-4b87-ae2a-b8e9b93f249b tempest-VolumesNegativeTest-629602989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2afc0664-4402-4ce0-a141-371e35b8b6c4 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:40 devstack sudo[86995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2afc0664-4402-4ce0-a141-371e35b8b6c4 Apr 10 10:37:40 devstack sudo[86995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-ed4b599f-5f2c-4e0f-a306-cc319fcf286e tempest-VolumesListTestJSON-944684155 None] Acquiring lock "cinder-7abd2413-47f7-472b-9cc6-4dd292ae7887-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-ed4b599f-5f2c-4e0f-a306-cc319fcf286e tempest-VolumesListTestJSON-944684155 None] Lock "cinder-7abd2413-47f7-472b-9cc6-4dd292ae7887-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-ed4b599f-5f2c-4e0f-a306-cc319fcf286e tempest-VolumesListTestJSON-944684155 None] Acquiring lock "cinder-quobyte-7abd2413-47f7-472b-9cc6-4dd292ae7887" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-ed4b599f-5f2c-4e0f-a306-cc319fcf286e tempest-VolumesListTestJSON-944684155 None] Lock "cinder-quobyte-7abd2413-47f7-472b-9cc6-4dd292ae7887" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fdbd4c-4c4a-4134-b8bf-e33dc6013bac]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-ed4b599f-5f2c-4e0f-a306-cc319fcf286e tempest-VolumesListTestJSON-944684155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7abd2413-47f7-472b-9cc6-4dd292ae7887 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:40 devstack sudo[86988]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-46511750-b54f-4e05-8c13-36189b54dff9 tempest-VolumesDeleteCascade-1096754520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bdf55c6f-20ca-461b-ad7d-da9f3ec32e52" returned: 0 in 0.630s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-46511750-b54f-4e05-8c13-36189b54dff9 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bdf55c6f-20ca-461b-ad7d-da9f3ec32e52 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:40 devstack sudo[87004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bdf55c6f-20ca-461b-ad7d-da9f3ec32e52 Apr 10 10:37:40 devstack sudo[87004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:40 devstack sudo[87002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7abd2413-47f7-472b-9cc6-4dd292ae7887 Apr 10 10:37:40 devstack sudo[87002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:40 devstack sudo[86991]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f 1073741824" returned: 0 in 0.723s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:40 devstack sudo[86995]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d2e675cb-4799-4b87-ae2a-b8e9b93f249b tempest-VolumesNegativeTest-629602989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2afc0664-4402-4ce0-a141-371e35b8b6c4" returned: 0 in 0.569s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-d2e675cb-4799-4b87-ae2a-b8e9b93f249b tempest-VolumesNegativeTest-629602989 None] Lock "cinder-quobyte-2afc0664-4402-4ce0-a141-371e35b8b6c4" released by "delete_volume" :: held 1.272s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:40 devstack sudo[87008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f Apr 10 10:37:40 devstack sudo[87008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-d2e675cb-4799-4b87-ae2a-b8e9b93f249b tempest-VolumesNegativeTest-629602989 None] Created reservations ['7fd319e2-c408-4869-aaad-778f1f72d80c', '9482b1b4-db7c-43d4-984f-bc242e6ce3fe', '340c4767-c66c-45dc-8f30-a7104a9e1f78', '534d23f5-6082-4faa-b7a7-ef0a45667c13'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d2e675cb-4799-4b87-ae2a-b8e9b93f249b tempest-VolumesNegativeTest-629602989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d2e675cb-4799-4b87-ae2a-b8e9b93f249b tempest-VolumesNegativeTest-629602989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-d2e675cb-4799-4b87-ae2a-b8e9b93f249b tempest-VolumesNegativeTest-629602989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-d2e675cb-4799-4b87-ae2a-b8e9b93f249b tempest-VolumesNegativeTest-629602989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d2e675cb-4799-4b87-ae2a-b8e9b93f249b tempest-VolumesNegativeTest-629602989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d2e675cb-4799-4b87-ae2a-b8e9b93f249b tempest-VolumesNegativeTest-629602989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:40 devstack sudo[87010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:37:40 devstack sudo[87010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:41 devstack sudo[87004]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-46511750-b54f-4e05-8c13-36189b54dff9 tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-bdf55c6f-20ca-461b-ad7d-da9f3ec32e52" returned: 0 in 0.563s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-46511750-b54f-4e05-8c13-36189b54dff9 tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-quobyte-bdf55c6f-20ca-461b-ad7d-da9f3ec32e52" released by "delete_volume" :: held 1.221s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-46511750-b54f-4e05-8c13-36189b54dff9 tempest-VolumesDeleteCascade-1096754520 None] Created reservations ['7521e4e8-5394-477d-9afc-6d7e6ea71976', '65987df4-e980-490a-838a-e4562df0c829', 'd4a16537-f99e-442e-9a59-31051d27a9f0', '7ad86c3c-4249-4196-8622-06a893642dd6'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:41 devstack sudo[87002]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-ed4b599f-5f2c-4e0f-a306-cc319fcf286e tempest-VolumesListTestJSON-944684155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7abd2413-47f7-472b-9cc6-4dd292ae7887" returned: 0 in 0.676s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-ed4b599f-5f2c-4e0f-a306-cc319fcf286e tempest-VolumesListTestJSON-944684155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7abd2413-47f7-472b-9cc6-4dd292ae7887 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:41 devstack sudo[87016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7abd2413-47f7-472b-9cc6-4dd292ae7887 Apr 10 10:37:41 devstack sudo[87016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-46511750-b54f-4e05-8c13-36189b54dff9 tempest-VolumesDeleteCascade-1096754520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-46511750-b54f-4e05-8c13-36189b54dff9 tempest-VolumesDeleteCascade-1096754520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-46511750-b54f-4e05-8c13-36189b54dff9 tempest-VolumesDeleteCascade-1096754520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-46511750-b54f-4e05-8c13-36189b54dff9 tempest-VolumesDeleteCascade-1096754520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-46511750-b54f-4e05-8c13-36189b54dff9 tempest-VolumesDeleteCascade-1096754520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-46511750-b54f-4e05-8c13-36189b54dff9 tempest-VolumesDeleteCascade-1096754520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:41 devstack sudo[87018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:37:41 devstack sudo[87018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:41 devstack sudo[87008]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f" returned: 0 in 0.608s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] <== create_volume: return (1366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70978515-cc0a-43fa-ac79-0f3a7dfcabc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5098000-b78f-4748-917d-ca8df8aefe6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:41 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] Volume volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f (b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f): created successfully Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5098000-b78f-4748-917d-ca8df8aefe6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] Flow 'volume_create_manager' (81b81e91-ee48-449c-b7c7-0f6f513b494a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:41 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-5c97ee17-b369-404a-b441-92453ccaa978 tempest-VolumesActionsTest-583784559 None] Created volume successfully. Apr 10 10:37:41 devstack sudo[87010]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d2e675cb-4799-4b87-ae2a-b8e9b93f249b tempest-VolumesNegativeTest-629602989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.552s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-d2e675cb-4799-4b87-ae2a-b8e9b93f249b tempest-VolumesNegativeTest-629602989 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:41 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-d2e675cb-4799-4b87-ae2a-b8e9b93f249b tempest-VolumesNegativeTest-629602989 None] Deleted volume successfully. Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-d2e675cb-4799-4b87-ae2a-b8e9b93f249b tempest-VolumesNegativeTest-629602989 None] Lock "cinder-2afc0664-4402-4ce0-a141-371e35b8b6c4-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:41 devstack sudo[87016]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-ed4b599f-5f2c-4e0f-a306-cc319fcf286e tempest-VolumesListTestJSON-944684155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7abd2413-47f7-472b-9cc6-4dd292ae7887" returned: 0 in 0.463s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-ed4b599f-5f2c-4e0f-a306-cc319fcf286e tempest-VolumesListTestJSON-944684155 None] Lock "cinder-quobyte-7abd2413-47f7-472b-9cc6-4dd292ae7887" released by "delete_volume" :: held 1.177s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-ed4b599f-5f2c-4e0f-a306-cc319fcf286e tempest-VolumesListTestJSON-944684155 None] Created reservations ['26212f9d-2436-443c-8742-1c91ebdc52a5', '26e25222-5746-4127-a3b0-54276d88b81d', '066a3900-daf4-4cd6-ab01-8a1c277e464b', '4d1f771b-4921-4f05-8b4f-9787508d1e81'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:41 devstack sudo[87018]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-46511750-b54f-4e05-8c13-36189b54dff9 tempest-VolumesDeleteCascade-1096754520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.478s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-46511750-b54f-4e05-8c13-36189b54dff9 tempest-VolumesDeleteCascade-1096754520 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:41 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-46511750-b54f-4e05-8c13-36189b54dff9 tempest-VolumesDeleteCascade-1096754520 None] Deleted volume successfully. Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-ed4b599f-5f2c-4e0f-a306-cc319fcf286e tempest-VolumesListTestJSON-944684155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-ed4b599f-5f2c-4e0f-a306-cc319fcf286e tempest-VolumesListTestJSON-944684155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-ed4b599f-5f2c-4e0f-a306-cc319fcf286e tempest-VolumesListTestJSON-944684155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-ed4b599f-5f2c-4e0f-a306-cc319fcf286e tempest-VolumesListTestJSON-944684155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-ed4b599f-5f2c-4e0f-a306-cc319fcf286e tempest-VolumesListTestJSON-944684155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-ed4b599f-5f2c-4e0f-a306-cc319fcf286e tempest-VolumesListTestJSON-944684155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:41 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-46511750-b54f-4e05-8c13-36189b54dff9 tempest-VolumesDeleteCascade-1096754520 None] Lock "cinder-bdf55c6f-20ca-461b-ad7d-da9f3ec32e52-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:41 devstack sudo[87024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:37:41 devstack sudo[87024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:42 devstack sudo[87024]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-ed4b599f-5f2c-4e0f-a306-cc319fcf286e tempest-VolumesListTestJSON-944684155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.702s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:42 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-ed4b599f-5f2c-4e0f-a306-cc319fcf286e tempest-VolumesListTestJSON-944684155 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:42 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-ed4b599f-5f2c-4e0f-a306-cc319fcf286e tempest-VolumesListTestJSON-944684155 None] Deleted volume successfully. Apr 10 10:37:42 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-ed4b599f-5f2c-4e0f-a306-cc319fcf286e tempest-VolumesListTestJSON-944684155 None] Lock "cinder-7abd2413-47f7-472b-9cc6-4dd292ae7887-delete_volume" released by "delete_volume" :: held 2.046s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:42 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7428df28-6d89-452a-b854-b2cc55e9cf74 tempest-VolumesListTestJSON-944684155 None] Acquiring lock "cinder-f2cb72a6-e3d3-4728-955b-8c2ea29425e6-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:42 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7428df28-6d89-452a-b854-b2cc55e9cf74 tempest-VolumesListTestJSON-944684155 None] Lock "cinder-f2cb72a6-e3d3-4728-955b-8c2ea29425e6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:42 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7428df28-6d89-452a-b854-b2cc55e9cf74 tempest-VolumesListTestJSON-944684155 None] Acquiring lock "cinder-quobyte-f2cb72a6-e3d3-4728-955b-8c2ea29425e6" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:42 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7428df28-6d89-452a-b854-b2cc55e9cf74 tempest-VolumesListTestJSON-944684155 None] Lock "cinder-quobyte-f2cb72a6-e3d3-4728-955b-8c2ea29425e6" acquired by "delete_volume" :: waited 0.011s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:42 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[901ddf05-d545-479c-abca-7bd8752a7ba0]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7428df28-6d89-452a-b854-b2cc55e9cf74 tempest-VolumesListTestJSON-944684155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f2cb72a6-e3d3-4728-955b-8c2ea29425e6 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:42 devstack sudo[87027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f2cb72a6-e3d3-4728-955b-8c2ea29425e6 Apr 10 10:37:42 devstack sudo[87027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:43 devstack sudo[87027]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7428df28-6d89-452a-b854-b2cc55e9cf74 tempest-VolumesListTestJSON-944684155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f2cb72a6-e3d3-4728-955b-8c2ea29425e6" returned: 0 in 0.726s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7428df28-6d89-452a-b854-b2cc55e9cf74 tempest-VolumesListTestJSON-944684155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f2cb72a6-e3d3-4728-955b-8c2ea29425e6 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:43 devstack sudo[87032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f2cb72a6-e3d3-4728-955b-8c2ea29425e6 Apr 10 10:37:43 devstack sudo[87032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:43 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] Flow 'volume_create_manager' (d785d36a-f8cf-4b34-a5a4-cd81491cd2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d7f4d70-e18f-4283-8f82-22cfea19f864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d7f4d70-e18f-4283-8f82-22cfea19f864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2140330200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=268815d6-e220-4379-9b72-1304ea1bf07e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e32f25b635da4ece8e8c0266f4d9699e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:44Z,use_quota=True,user_id='96d786bec3b7445f9b78f408110af45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8208b20-b1f4-461f-b531-308fb6563160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8208b20-b1f4-461f-b531-308fb6563160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d0c6e9-f660-4ea7-b249-b7a974aaff11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d0c6e9-f660-4ea7-b249-b7a974aaff11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '268815d6-e220-4379-9b72-1304ea1bf07e', 'volume_name': 'volume-268815d6-e220-4379-9b72-1304ea1bf07e', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (071f04c4-d999-4a55-abdd-e90c19f448b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (071f04c4-d999-4a55-abdd-e90c19f448b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c88d56d-3162-4cee-99e8-580f1bfb2193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:43 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] Volume 268815d6-e220-4379-9b72-1304ea1bf07e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-268815d6-e220-4379-9b72-1304ea1bf07e', 'volume_size': 1} Apr 10 10:37:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:43 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2140330200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=268815d6-e220-4379-9b72-1304ea1bf07e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e32f25b635da4ece8e8c0266f4d9699e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:44Z,use_quota=True,user_id='96d786bec3b7445f9b78f408110af45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:43 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] Creating volume 268815d6-e220-4379-9b72-1304ea1bf07e {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:43 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:43 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:43 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:43 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:37:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:43 devstack sudo[87034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e 1073741824 Apr 10 10:37:43 devstack sudo[87034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:44 devstack sudo[87032]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7428df28-6d89-452a-b854-b2cc55e9cf74 tempest-VolumesListTestJSON-944684155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f2cb72a6-e3d3-4728-955b-8c2ea29425e6" returned: 0 in 0.615s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:44 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7428df28-6d89-452a-b854-b2cc55e9cf74 tempest-VolumesListTestJSON-944684155 None] Lock "cinder-quobyte-f2cb72a6-e3d3-4728-955b-8c2ea29425e6" released by "delete_volume" :: held 1.367s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:44 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-7428df28-6d89-452a-b854-b2cc55e9cf74 tempest-VolumesListTestJSON-944684155 None] Created reservations ['7babec00-5e77-49bd-a43d-b3037058cd7d', '1a806e73-0e72-4745-858d-5fa1dad571b4', '83d92d1d-80e2-42ca-b416-31cc8600535f', 'd0c18323-c070-481e-a4e3-835ea7381324'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7428df28-6d89-452a-b854-b2cc55e9cf74 tempest-VolumesListTestJSON-944684155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7428df28-6d89-452a-b854-b2cc55e9cf74 tempest-VolumesListTestJSON-944684155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:44 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7428df28-6d89-452a-b854-b2cc55e9cf74 tempest-VolumesListTestJSON-944684155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:44 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7428df28-6d89-452a-b854-b2cc55e9cf74 tempest-VolumesListTestJSON-944684155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7428df28-6d89-452a-b854-b2cc55e9cf74 tempest-VolumesListTestJSON-944684155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7428df28-6d89-452a-b854-b2cc55e9cf74 tempest-VolumesListTestJSON-944684155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:44 devstack sudo[87037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:37:44 devstack sudo[87037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:44 devstack sudo[87034]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e 1073741824" returned: 0 in 0.704s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:44 devstack sudo[87042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e Apr 10 10:37:44 devstack sudo[87042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] Flow 'volume_create_manager' (f6da3588-fea1-4efe-875c-6a2a95bdd119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a06a6075-dd58-48e8-b96a-5da9f79b9286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:45 devstack sudo[87037]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a06a6075-dd58-48e8-b96a-5da9f79b9286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1046652062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b58e91bc-4eb7-491b-8bef-74b68820bd53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0612a2b22f774ac48e729c015b1cf161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:45Z,use_quota=True,user_id='1acf1a4fe1bb478f8df1e9e5df52188d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f8cba6b-5f53-40d2-9c76-b5ffb63b3b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f8cba6b-5f53-40d2-9c76-b5ffb63b3b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e44743-8183-4b14-8b4b-c908df5bad9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e44743-8183-4b14-8b4b-c908df5bad9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b58e91bc-4eb7-491b-8bef-74b68820bd53', 'volume_name': 'volume-b58e91bc-4eb7-491b-8bef-74b68820bd53', 'volume_size': 2}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de00b2bd-ae33-4561-ae49-f7d1c2a9f4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de00b2bd-ae33-4561-ae49-f7d1c2a9f4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f08a743-8b32-4a87-9805-df6b1369692e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:45 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] Volume b58e91bc-4eb7-491b-8bef-74b68820bd53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b58e91bc-4eb7-491b-8bef-74b68820bd53', 'volume_size': 2} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-58c749db-4844-47e2-b2d2-6e73c0cc93c0 tempest-VolumesListTestJSON-944684155 None] Acquiring lock "cinder-152c8d8d-ac56-4e27-9b3a-2104d8bd1cf3-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7428df28-6d89-452a-b854-b2cc55e9cf74 tempest-VolumesListTestJSON-944684155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.715s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-7428df28-6d89-452a-b854-b2cc55e9cf74 tempest-VolumesListTestJSON-944684155 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:45 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-7428df28-6d89-452a-b854-b2cc55e9cf74 tempest-VolumesListTestJSON-944684155 None] Deleted volume successfully. Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-58c749db-4844-47e2-b2d2-6e73c0cc93c0 tempest-VolumesListTestJSON-944684155 None] Lock "cinder-152c8d8d-ac56-4e27-9b3a-2104d8bd1cf3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7428df28-6d89-452a-b854-b2cc55e9cf74 tempest-VolumesListTestJSON-944684155 None] Lock "cinder-f2cb72a6-e3d3-4728-955b-8c2ea29425e6-delete_volume" released by "delete_volume" :: held 2.362s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-58c749db-4844-47e2-b2d2-6e73c0cc93c0 tempest-VolumesListTestJSON-944684155 None] Acquiring lock "cinder-quobyte-152c8d8d-ac56-4e27-9b3a-2104d8bd1cf3" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-58c749db-4844-47e2-b2d2-6e73c0cc93c0 tempest-VolumesListTestJSON-944684155 None] Lock "cinder-quobyte-152c8d8d-ac56-4e27-9b3a-2104d8bd1cf3" acquired by "delete_volume" :: waited 0.007s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bfebaa-ca0f-42e6-b245-2a6183d57858]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-58c749db-4844-47e2-b2d2-6e73c0cc93c0 tempest-VolumesListTestJSON-944684155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-152c8d8d-ac56-4e27-9b3a-2104d8bd1cf3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:45 devstack sudo[87042]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e" returned: 0 in 0.583s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.152s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1046652062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b58e91bc-4eb7-491b-8bef-74b68820bd53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0612a2b22f774ac48e729c015b1cf161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:45Z,use_quota=True,user_id='1acf1a4fe1bb478f8df1e9e5df52188d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] Creating volume b58e91bc-4eb7-491b-8bef-74b68820bd53 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:45 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b58e91bc-4eb7-491b-8bef-74b68820bd53 2147483648 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c88d56d-3162-4cee-99e8-580f1bfb2193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-268815d6-e220-4379-9b72-1304ea1bf07e', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd88d22-f4cb-4775-bd5b-4708bee945c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:45 devstack sudo[87047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b58e91bc-4eb7-491b-8bef-74b68820bd53 2147483648 Apr 10 10:37:45 devstack sudo[87047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:45 devstack sudo[87046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-152c8d8d-ac56-4e27-9b3a-2104d8bd1cf3 Apr 10 10:37:45 devstack sudo[87046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:45 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] Volume volume-268815d6-e220-4379-9b72-1304ea1bf07e (268815d6-e220-4379-9b72-1304ea1bf07e): created successfully Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd88d22-f4cb-4775-bd5b-4708bee945c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] Flow 'volume_create_manager' (d785d36a-f8cf-4b34-a5a4-cd81491cd2ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:45 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-e2ab0f9e-e6a7-4255-8e5a-60de0f40444e tempest-VolumesSnapshotListTestJSON-377902434 None] Created volume successfully. Apr 10 10:37:45 devstack sudo[87046]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-58c749db-4844-47e2-b2d2-6e73c0cc93c0 tempest-VolumesListTestJSON-944684155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-152c8d8d-ac56-4e27-9b3a-2104d8bd1cf3" returned: 0 in 0.526s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-58c749db-4844-47e2-b2d2-6e73c0cc93c0 tempest-VolumesListTestJSON-944684155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-152c8d8d-ac56-4e27-9b3a-2104d8bd1cf3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:45 devstack sudo[87056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-152c8d8d-ac56-4e27-9b3a-2104d8bd1cf3 Apr 10 10:37:45 devstack sudo[87056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:45 devstack sudo[87047]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b58e91bc-4eb7-491b-8bef-74b68820bd53 2147483648" returned: 0 in 0.637s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b58e91bc-4eb7-491b-8bef-74b68820bd53 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:45 devstack sudo[87058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b58e91bc-4eb7-491b-8bef-74b68820bd53 Apr 10 10:37:45 devstack sudo[87058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6479a88d-1cf4-439f-8495-ecec0177adbd tempest-VolumesSnapshotListTestJSON-377902434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:46 devstack sudo[87056]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-58c749db-4844-47e2-b2d2-6e73c0cc93c0 tempest-VolumesListTestJSON-944684155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-152c8d8d-ac56-4e27-9b3a-2104d8bd1cf3" returned: 0 in 0.566s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:46 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-58c749db-4844-47e2-b2d2-6e73c0cc93c0 tempest-VolumesListTestJSON-944684155 None] Lock "cinder-quobyte-152c8d8d-ac56-4e27-9b3a-2104d8bd1cf3" released by "delete_volume" :: held 1.120s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:46 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-58c749db-4844-47e2-b2d2-6e73c0cc93c0 tempest-VolumesListTestJSON-944684155 None] Created reservations ['00073d1c-d437-4186-863f-8d8dd93ebf4f', 'f7e43713-f87f-4d26-b622-e075a2e27921', '4deea281-0d08-43cc-8661-2f369948cc04', 'e5555489-8fce-45d8-8d6a-25952abd8034'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-58c749db-4844-47e2-b2d2-6e73c0cc93c0 tempest-VolumesListTestJSON-944684155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-58c749db-4844-47e2-b2d2-6e73c0cc93c0 tempest-VolumesListTestJSON-944684155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:46 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-58c749db-4844-47e2-b2d2-6e73c0cc93c0 tempest-VolumesListTestJSON-944684155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:46 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-58c749db-4844-47e2-b2d2-6e73c0cc93c0 tempest-VolumesListTestJSON-944684155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-58c749db-4844-47e2-b2d2-6e73c0cc93c0 tempest-VolumesListTestJSON-944684155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-58c749db-4844-47e2-b2d2-6e73c0cc93c0 tempest-VolumesListTestJSON-944684155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:46 devstack sudo[87062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:37:46 devstack sudo[87062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:46 devstack sudo[87058]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b58e91bc-4eb7-491b-8bef-74b68820bd53" returned: 0 in 0.540s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:46 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6479a88d-1cf4-439f-8495-ecec0177adbd tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.329s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f08a743-8b32-4a87-9805-df6b1369692e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b58e91bc-4eb7-491b-8bef-74b68820bd53', 'volume_size': 2}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ed9796-6ec2-4caa-943a-bf637ee31a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:46 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-6479a88d-1cf4-439f-8495-ecec0177adbd tempest-VolumesSnapshotListTestJSON-377902434 None] Creating offline snapshot 3f55acfb-e52e-472c-b826-8633d1212aa1 of volume 268815d6-e220-4379-9b72-1304ea1bf07e {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:37:46 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] Volume volume-b58e91bc-4eb7-491b-8bef-74b68820bd53 (b58e91bc-4eb7-491b-8bef-74b68820bd53): created successfully Apr 10 10:37:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ed9796-6ec2-4caa-943a-bf637ee31a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] Flow 'volume_create_manager' (f6da3588-fea1-4efe-875c-6a2a95bdd119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:46 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf5f20f-2d83-45e7-aa25-3f29a5299be7]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6479a88d-1cf4-439f-8495-ecec0177adbd tempest-VolumesSnapshotListTestJSON-377902434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:46 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-873e0667-2474-4045-9d3c-4ffa7d232f66 tempest-VolumesCloneNegativeTest-2129235790 None] Created volume successfully. Apr 10 10:37:46 devstack sudo[87064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e Apr 10 10:37:46 devstack sudo[87064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:46 devstack sudo[87062]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-58c749db-4844-47e2-b2d2-6e73c0cc93c0 tempest-VolumesListTestJSON-944684155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.476s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:46 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-58c749db-4844-47e2-b2d2-6e73c0cc93c0 tempest-VolumesListTestJSON-944684155 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:46 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-58c749db-4844-47e2-b2d2-6e73c0cc93c0 tempest-VolumesListTestJSON-944684155 None] Deleted volume successfully. Apr 10 10:37:46 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-58c749db-4844-47e2-b2d2-6e73c0cc93c0 tempest-VolumesListTestJSON-944684155 None] Lock "cinder-152c8d8d-ac56-4e27-9b3a-2104d8bd1cf3-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:47 devstack sudo[87064]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6479a88d-1cf4-439f-8495-ecec0177adbd tempest-VolumesSnapshotListTestJSON-377902434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e" returned: 0 in 0.623s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6479a88d-1cf4-439f-8495-ecec0177adbd tempest-VolumesSnapshotListTestJSON-377902434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:47 devstack sudo[87070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1 1G Apr 10 10:37:47 devstack sudo[87070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:47 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-235d7693-d3ae-4825-80db-aaf477bc7ec6 tempest-VolumesCloneNegativeTest-2129235790 None] Acquiring lock "cinder-b58e91bc-4eb7-491b-8bef-74b68820bd53-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:47 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-235d7693-d3ae-4825-80db-aaf477bc7ec6 tempest-VolumesCloneNegativeTest-2129235790 None] Lock "cinder-b58e91bc-4eb7-491b-8bef-74b68820bd53-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:47 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-235d7693-d3ae-4825-80db-aaf477bc7ec6 tempest-VolumesCloneNegativeTest-2129235790 None] Acquiring lock "cinder-quobyte-b58e91bc-4eb7-491b-8bef-74b68820bd53" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:47 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-235d7693-d3ae-4825-80db-aaf477bc7ec6 tempest-VolumesCloneNegativeTest-2129235790 None] Lock "cinder-quobyte-b58e91bc-4eb7-491b-8bef-74b68820bd53" acquired by "delete_volume" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:47 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[b076c0c2-6407-4cec-ad1a-adb52beb28b3]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-235d7693-d3ae-4825-80db-aaf477bc7ec6 tempest-VolumesCloneNegativeTest-2129235790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b58e91bc-4eb7-491b-8bef-74b68820bd53 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:47 devstack sudo[87072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b58e91bc-4eb7-491b-8bef-74b68820bd53 Apr 10 10:37:47 devstack sudo[87072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:47 devstack sudo[87070]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6479a88d-1cf4-439f-8495-ecec0177adbd tempest-VolumesSnapshotListTestJSON-377902434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1 1G" returned: 0 in 0.694s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6479a88d-1cf4-439f-8495-ecec0177adbd tempest-VolumesSnapshotListTestJSON-377902434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-268815d6-e220-4379-9b72-1304ea1bf07e -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:47 devstack sudo[87078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-268815d6-e220-4379-9b72-1304ea1bf07e -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1 Apr 10 10:37:47 devstack sudo[87078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:48 devstack sudo[87072]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-235d7693-d3ae-4825-80db-aaf477bc7ec6 tempest-VolumesCloneNegativeTest-2129235790 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b58e91bc-4eb7-491b-8bef-74b68820bd53" returned: 0 in 0.700s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-235d7693-d3ae-4825-80db-aaf477bc7ec6 tempest-VolumesCloneNegativeTest-2129235790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b58e91bc-4eb7-491b-8bef-74b68820bd53 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:48 devstack cinder-volume[81938]: DEBUG oslo_service.periodic_task [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81938) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:37:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:48 devstack sudo[87082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b58e91bc-4eb7-491b-8bef-74b68820bd53 Apr 10 10:37:48 devstack sudo[87082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:48 devstack sudo[87083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:37:48 devstack sudo[87083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:48 devstack sudo[87078]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6479a88d-1cf4-439f-8495-ecec0177adbd tempest-VolumesSnapshotListTestJSON-377902434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-268815d6-e220-4379-9b72-1304ea1bf07e -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1" returned: 0 in 0.714s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:48 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-6479a88d-1cf4-439f-8495-ecec0177adbd tempest-VolumesSnapshotListTestJSON-377902434 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1 is being set with open permissions: ugo+rw Apr 10 10:37:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6479a88d-1cf4-439f-8495-ecec0177adbd tempest-VolumesSnapshotListTestJSON-377902434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:48 devstack sudo[87090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1 Apr 10 10:37:48 devstack sudo[87090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:48 devstack sudo[87082]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-235d7693-d3ae-4825-80db-aaf477bc7ec6 tempest-VolumesCloneNegativeTest-2129235790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b58e91bc-4eb7-491b-8bef-74b68820bd53" returned: 0 in 0.685s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:48 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-235d7693-d3ae-4825-80db-aaf477bc7ec6 tempest-VolumesCloneNegativeTest-2129235790 None] Lock "cinder-quobyte-b58e91bc-4eb7-491b-8bef-74b68820bd53" released by "delete_volume" :: held 1.420s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:48 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-235d7693-d3ae-4825-80db-aaf477bc7ec6 tempest-VolumesCloneNegativeTest-2129235790 None] Created reservations ['babb147b-b853-4b95-8e0c-e39a4724a075', 'aeb56154-c063-455b-a311-acea5981c144', 'd27d8f31-fe3d-4678-89bd-53c922c4b145', '3e04e31a-7977-4af9-a69d-5d03775cf5c3'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-235d7693-d3ae-4825-80db-aaf477bc7ec6 tempest-VolumesCloneNegativeTest-2129235790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-235d7693-d3ae-4825-80db-aaf477bc7ec6 tempest-VolumesCloneNegativeTest-2129235790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-235d7693-d3ae-4825-80db-aaf477bc7ec6 tempest-VolumesCloneNegativeTest-2129235790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-235d7693-d3ae-4825-80db-aaf477bc7ec6 tempest-VolumesCloneNegativeTest-2129235790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-235d7693-d3ae-4825-80db-aaf477bc7ec6 tempest-VolumesCloneNegativeTest-2129235790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-235d7693-d3ae-4825-80db-aaf477bc7ec6 tempest-VolumesCloneNegativeTest-2129235790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:48 devstack sudo[87098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:37:48 devstack sudo[87098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:49 devstack sudo[87083]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 1.058s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:49 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:49 devstack sudo[87090]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6479a88d-1cf4-439f-8495-ecec0177adbd tempest-VolumesSnapshotListTestJSON-377902434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1" returned: 0 in 0.804s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6479a88d-1cf4-439f-8495-ecec0177adbd tempest-VolumesSnapshotListTestJSON-377902434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:49 devstack sudo[87104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.info Apr 10 10:37:49 devstack sudo[87104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:49 devstack sudo[87098]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-235d7693-d3ae-4825-80db-aaf477bc7ec6 tempest-VolumesCloneNegativeTest-2129235790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.813s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:49 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-235d7693-d3ae-4825-80db-aaf477bc7ec6 tempest-VolumesCloneNegativeTest-2129235790 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:49 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-235d7693-d3ae-4825-80db-aaf477bc7ec6 tempest-VolumesCloneNegativeTest-2129235790 None] Deleted volume successfully. Apr 10 10:37:49 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-235d7693-d3ae-4825-80db-aaf477bc7ec6 tempest-VolumesCloneNegativeTest-2129235790 None] Lock "cinder-b58e91bc-4eb7-491b-8bef-74b68820bd53-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:50 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] Flow 'volume_create_manager' (94a77a67-f036-4b4d-bd3f-bdc561b6dbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139d2436-d6c5-4ed5-9492-de06bf19625c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139d2436-d6c5-4ed5-9492-de06bf19625c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-407561064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2bd37788c64253ac091e9102e1a24a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:50Z,use_quota=True,user_id='145d2c5358394455a56c9859f18e4ca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ecaf3dc-a285-42ff-a73b-4fbaa10d9703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ecaf3dc-a285-42ff-a73b-4fbaa10d9703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68bfb218-c122-4ee0-9f52-7e9e97ac5576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68bfb218-c122-4ee0-9f52-7e9e97ac5576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac', 'volume_name': 'volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (340017c9-0f47-4e71-b47c-ec596634333c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (340017c9-0f47-4e71-b47c-ec596634333c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26dac479-1aa4-4ea4-9b42-65fe6e1782d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:50 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] Volume c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac', 'volume_size': 1} Apr 10 10:37:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:50 devstack sudo[87104]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6479a88d-1cf4-439f-8495-ecec0177adbd tempest-VolumesSnapshotListTestJSON-377902434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.info" returned: 0 in 0.898s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:50 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-6479a88d-1cf4-439f-8495-ecec0177adbd tempest-VolumesSnapshotListTestJSON-377902434 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.info is being set with open permissions: ugo+rw Apr 10 10:37:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6479a88d-1cf4-439f-8495-ecec0177adbd tempest-VolumesSnapshotListTestJSON-377902434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:50 devstack sudo[87125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.info Apr 10 10:37:50 devstack sudo[87125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:50 devstack sudo[87125]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6479a88d-1cf4-439f-8495-ecec0177adbd tempest-VolumesSnapshotListTestJSON-377902434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.info" returned: 0 in 0.541s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6479a88d-1cf4-439f-8495-ecec0177adbd tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.365s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.712s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:50 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-407561064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2bd37788c64253ac091e9102e1a24a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:50Z,use_quota=True,user_id='145d2c5358394455a56c9859f18e4ca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:50 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] Creating volume c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:50 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:50 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:50 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:50 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:37:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:50 devstack sudo[87128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac 1073741824 Apr 10 10:37:50 devstack sudo[87128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:50 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-6479a88d-1cf4-439f-8495-ecec0177adbd tempest-VolumesSnapshotListTestJSON-377902434 None] Create snapshot completed successfully Apr 10 10:37:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-bdf8ecf5-e0a2-4f07-b0cc-711f64cbb45d tempest-VolumesSnapshotListTestJSON-377902434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:51 devstack sudo[87128]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac 1073741824" returned: 0 in 0.719s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:51 devstack sudo[87133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac Apr 10 10:37:51 devstack sudo[87133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:51 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] Flow 'volume_create_manager' (8a29d3b4-dd7f-4991-9bb5-1f6c8e652c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18113bfd-5e61-476f-a171-2ba52e324ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18113bfd-5e61-476f-a171-2ba52e324ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1516488028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0619404-125f-4eed-b10e-5369be9eb298,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='69a9c60134b743c9856d1cc12e58ad43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:52Z,use_quota=True,user_id='99b2c59b40aa4ed6925ceb4e538b7ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b90f3a23-8145-4e0e-af87-d5eec00513c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b90f3a23-8145-4e0e-af87-d5eec00513c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc642ef-2baa-41bf-971d-13cb1a1b7e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc642ef-2baa-41bf-971d-13cb1a1b7e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0619404-125f-4eed-b10e-5369be9eb298', 'volume_name': 'volume-c0619404-125f-4eed-b10e-5369be9eb298', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60248d63-17fc-4270-8b0f-bcf751623fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60248d63-17fc-4270-8b0f-bcf751623fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd1a285-a7bc-483b-abd0-6502dc129f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:51 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] Volume c0619404-125f-4eed-b10e-5369be9eb298: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0619404-125f-4eed-b10e-5369be9eb298', 'volume_size': 1} Apr 10 10:37:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:52 devstack sudo[87133]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac" returned: 0 in 0.592s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:52 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-bdf8ecf5-e0a2-4f07-b0cc-711f64cbb45d tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.659s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:52 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26dac479-1aa4-4ea4-9b42-65fe6e1782d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:52 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (968e915e-926b-4a8a-8203-e58ae574b2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:52 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-bdf8ecf5-e0a2-4f07-b0cc-711f64cbb45d tempest-VolumesSnapshotListTestJSON-377902434 None] Creating offline snapshot a9c00a40-4a42-4803-b492-3dd5c356f8ae of volume 268815d6-e220-4379-9b72-1304ea1bf07e {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:37:52 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] Volume volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac (c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac): created successfully Apr 10 10:37:52 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (968e915e-926b-4a8a-8203-e58ae574b2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:52 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] Flow 'volume_create_manager' (94a77a67-f036-4b4d-bd3f-bdc561b6dbe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:52 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b343adc-0410-407f-8263-67e1a8a67861]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bdf8ecf5-e0a2-4f07-b0cc-711f64cbb45d tempest-VolumesSnapshotListTestJSON-377902434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:52 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-fddfaf80-daeb-433c-ac29-caac380930aa tempest-CreateVolumesFromSnapshotTest-722925440 None] Created volume successfully. Apr 10 10:37:52 devstack sudo[87137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1 Apr 10 10:37:52 devstack sudo[87137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:52 devstack sudo[87137]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bdf8ecf5-e0a2-4f07-b0cc-711f64cbb45d tempest-VolumesSnapshotListTestJSON-377902434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1" returned: 0 in 0.502s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:52 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-bdf8ecf5-e0a2-4f07-b0cc-711f64cbb45d tempest-VolumesSnapshotListTestJSON-377902434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-268815d6-e220-4379-9b72-1304ea1bf07e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:37:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bdf8ecf5-e0a2-4f07-b0cc-711f64cbb45d tempest-VolumesSnapshotListTestJSON-377902434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:52 devstack sudo[87142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae 1G Apr 10 10:37:52 devstack sudo[87142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-dabd7165-4adb-47c4-93a2-4bd92adaff42 tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:53 devstack sudo[87142]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bdf8ecf5-e0a2-4f07-b0cc-711f64cbb45d tempest-VolumesSnapshotListTestJSON-377902434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae 1G" returned: 0 in 0.643s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bdf8ecf5-e0a2-4f07-b0cc-711f64cbb45d tempest-VolumesSnapshotListTestJSON-377902434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:53 devstack sudo[87147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae Apr 10 10:37:53 devstack sudo[87147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:53 devstack sudo[87147]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bdf8ecf5-e0a2-4f07-b0cc-711f64cbb45d tempest-VolumesSnapshotListTestJSON-377902434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae" returned: 0 in 0.496s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:53 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-bdf8ecf5-e0a2-4f07-b0cc-711f64cbb45d tempest-VolumesSnapshotListTestJSON-377902434 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae is being set with open permissions: ugo+rw Apr 10 10:37:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bdf8ecf5-e0a2-4f07-b0cc-711f64cbb45d tempest-VolumesSnapshotListTestJSON-377902434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:53 devstack sudo[87155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae Apr 10 10:37:53 devstack sudo[87155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:54 devstack sudo[87155]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bdf8ecf5-e0a2-4f07-b0cc-711f64cbb45d tempest-VolumesSnapshotListTestJSON-377902434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae" returned: 0 in 0.484s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-bdf8ecf5-e0a2-4f07-b0cc-711f64cbb45d tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.206s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.604s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:54 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1516488028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0619404-125f-4eed-b10e-5369be9eb298,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='69a9c60134b743c9856d1cc12e58ad43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:52Z,use_quota=True,user_id='99b2c59b40aa4ed6925ceb4e538b7ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:54 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] Creating volume c0619404-125f-4eed-b10e-5369be9eb298 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:54 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:54 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:54 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:54 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:37:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0619404-125f-4eed-b10e-5369be9eb298 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:54 devstack sudo[87158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0619404-125f-4eed-b10e-5369be9eb298 1073741824 Apr 10 10:37:54 devstack sudo[87158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:54 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-bdf8ecf5-e0a2-4f07-b0cc-711f64cbb45d tempest-VolumesSnapshotListTestJSON-377902434 None] Create snapshot completed successfully Apr 10 10:37:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6a0a2f23-cd6c-44da-b0aa-b3ee89c430f4 tempest-VolumesSnapshotListTestJSON-377902434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:55 devstack sudo[87158]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0619404-125f-4eed-b10e-5369be9eb298 1073741824" returned: 0 in 0.651s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0619404-125f-4eed-b10e-5369be9eb298 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:55 devstack sudo[87186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0619404-125f-4eed-b10e-5369be9eb298 Apr 10 10:37:55 devstack sudo[87186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:55 devstack sudo[87186]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0619404-125f-4eed-b10e-5369be9eb298" returned: 0 in 0.579s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:55 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-dabd7165-4adb-47c4-93a2-4bd92adaff42 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.387s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:55 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd1a285-a7bc-483b-abd0-6502dc129f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0619404-125f-4eed-b10e-5369be9eb298', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:55 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (575d3435-3e6b-4103-afa4-b060b8406ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:55 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-dabd7165-4adb-47c4-93a2-4bd92adaff42 tempest-CreateVolumesFromSnapshotTest-722925440 None] Creating offline snapshot 7bbecb8d-8ecc-4cee-923e-109c8686de22 of volume c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:37:55 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebe8be1-42de-43e0-96e1-0603a4dc67a5]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dabd7165-4adb-47c4-93a2-4bd92adaff42 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:55 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] Volume volume-c0619404-125f-4eed-b10e-5369be9eb298 (c0619404-125f-4eed-b10e-5369be9eb298): created successfully Apr 10 10:37:55 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (575d3435-3e6b-4103-afa4-b060b8406ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:55 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] Flow 'volume_create_manager' (8a29d3b4-dd7f-4991-9bb5-1f6c8e652c97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:55 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-e309c819-1bbd-483a-b503-fda32ca6de82 tempest-VolumesGetTest-1117816825 None] Created volume successfully. Apr 10 10:37:55 devstack sudo[87192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac Apr 10 10:37:55 devstack sudo[87192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:56 devstack sudo[87192]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dabd7165-4adb-47c4-93a2-4bd92adaff42 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac" returned: 0 in 0.645s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dabd7165-4adb-47c4-93a2-4bd92adaff42 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac.7bbecb8d-8ecc-4cee-923e-109c8686de22 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:56 devstack sudo[87197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac.7bbecb8d-8ecc-4cee-923e-109c8686de22 1G Apr 10 10:37:56 devstack sudo[87197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:56 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] Flow 'volume_create_manager' (e6416d92-0678-491f-bb1d-1eed4ab28fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5e5ffe3-bc8f-42b1-a4a7-47dec1af3c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5e5ffe3-bc8f-42b1-a4a7-47dec1af3c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1387511534',display_name='tempest-VolumesGetTest-Volume-1694703587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ed864f-09a5-4667-9e14-c8ad4195d4f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69a9c60134b743c9856d1cc12e58ad43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:57Z,use_quota=True,user_id='99b2c59b40aa4ed6925ceb4e538b7ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4283890b-e046-4ad8-b465-fe5551fdff55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4283890b-e046-4ad8-b465-fe5551fdff55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5d33bf-ce6c-42ce-97f1-7dff562e355b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5d33bf-ce6c-42ce-97f1-7dff562e355b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1ed864f-09a5-4667-9e14-c8ad4195d4f3', 'volume_name': 'volume-b1ed864f-09a5-4667-9e14-c8ad4195d4f3', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5519098e-5061-4230-aaed-8d36e7680ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5519098e-5061-4230-aaed-8d36e7680ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb44f42-1948-4252-97d5-d59edc1a5be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:56 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] Volume b1ed864f-09a5-4667-9e14-c8ad4195d4f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1ed864f-09a5-4667-9e14-c8ad4195d4f3', 'volume_size': 1} Apr 10 10:37:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:57 devstack sudo[87197]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dabd7165-4adb-47c4-93a2-4bd92adaff42 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac.7bbecb8d-8ecc-4cee-923e-109c8686de22 1G" returned: 0 in 0.680s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dabd7165-4adb-47c4-93a2-4bd92adaff42 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac.7bbecb8d-8ecc-4cee-923e-109c8686de22 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:57 devstack sudo[87202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac.7bbecb8d-8ecc-4cee-923e-109c8686de22 Apr 10 10:37:57 devstack sudo[87202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:57 devstack sudo[87202]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dabd7165-4adb-47c4-93a2-4bd92adaff42 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac.7bbecb8d-8ecc-4cee-923e-109c8686de22" returned: 0 in 0.533s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:57 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-dabd7165-4adb-47c4-93a2-4bd92adaff42 tempest-CreateVolumesFromSnapshotTest-722925440 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac.7bbecb8d-8ecc-4cee-923e-109c8686de22 is being set with open permissions: ugo+rw Apr 10 10:37:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dabd7165-4adb-47c4-93a2-4bd92adaff42 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac.7bbecb8d-8ecc-4cee-923e-109c8686de22 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:57 devstack sudo[87241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac.7bbecb8d-8ecc-4cee-923e-109c8686de22 Apr 10 10:37:57 devstack sudo[87241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:57 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c075c9cb-2de8-47b9-ab95-def6dacf7402 tempest-VolumesActionsTest-583784559 None] Acquiring lock "cinder-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f" by "attach_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:58 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c075c9cb-2de8-47b9-ab95-def6dacf7402 tempest-VolumesActionsTest-583784559 None] Lock "cinder-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f" acquired by "attach_volume" :: waited 0.012s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:58 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-c075c9cb-2de8-47b9-ab95-def6dacf7402 tempest-VolumesActionsTest-583784559 None] Attaching volume b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f to instance 9e32b371-b7eb-4f7d-9fcd-f45ba72feaaa at mountpoint /dev/vdb on host None. Apr 10 10:37:58 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-c075c9cb-2de8-47b9-ab95-def6dacf7402 tempest-VolumesActionsTest-583784559 None] Attach volume completed successfully. Apr 10 10:37:58 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c075c9cb-2de8-47b9-ab95-def6dacf7402 tempest-VolumesActionsTest-583784559 None] Lock "cinder-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f" released by "attach_volume" :: held 0.071s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:58 devstack sudo[87241]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dabd7165-4adb-47c4-93a2-4bd92adaff42 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac.7bbecb8d-8ecc-4cee-923e-109c8686de22" returned: 0 in 0.529s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dabd7165-4adb-47c4-93a2-4bd92adaff42 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:58 devstack sudo[87244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac.info Apr 10 10:37:58 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:58 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-30d5d904-05d8-4143-9bed-8bbc4fc3e00f tempest-VolumesActionsTest-583784559 None] Acquiring lock "cinder-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f-detach_volume" by "detach_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:58 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-30d5d904-05d8-4143-9bed-8bbc4fc3e00f tempest-VolumesActionsTest-583784559 None] Lock "cinder-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:58 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-30d5d904-05d8-4143-9bed-8bbc4fc3e00f tempest-VolumesActionsTest-583784559 None] Detaching volume b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f from instance 9e32b371-b7eb-4f7d-9fcd-f45ba72feaaa. Apr 10 10:37:58 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-30d5d904-05d8-4143-9bed-8bbc4fc3e00f tempest-VolumesActionsTest-583784559 None] Detach volume completed successfully. Apr 10 10:37:58 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-30d5d904-05d8-4143-9bed-8bbc4fc3e00f tempest-VolumesActionsTest-583784559 None] Lock "cinder-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f-detach_volume" released by "detach_volume" :: held 0.049s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:58 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dabd7165-4adb-47c4-93a2-4bd92adaff42 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac.info" returned: 0 in 0.497s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:58 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-dabd7165-4adb-47c4-93a2-4bd92adaff42 tempest-CreateVolumesFromSnapshotTest-722925440 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac.info is being set with open permissions: ugo+rw Apr 10 10:37:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dabd7165-4adb-47c4-93a2-4bd92adaff42 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:58 devstack sudo[87247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac.info Apr 10 10:37:58 devstack sudo[87247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:59 devstack sudo[87247]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dabd7165-4adb-47c4-93a2-4bd92adaff42 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac.info" returned: 0 in 0.451s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-dabd7165-4adb-47c4-93a2-4bd92adaff42 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.454s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6a0a2f23-cd6c-44da-b0aa-b3ee89c430f4 tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.359s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:59 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-6a0a2f23-cd6c-44da-b0aa-b3ee89c430f4 tempest-VolumesSnapshotListTestJSON-377902434 None] Creating offline snapshot 0ba95d07-b116-4186-8a49-6d2387580be1 of volume 268815d6-e220-4379-9b72-1304ea1bf07e {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:37:59 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-dabd7165-4adb-47c4-93a2-4bd92adaff42 tempest-CreateVolumesFromSnapshotTest-722925440 None] Create snapshot completed successfully Apr 10 10:37:59 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9e478d-689d-4ac7-98e3-c79a6118b762]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6a0a2f23-cd6c-44da-b0aa-b3ee89c430f4 tempest-VolumesSnapshotListTestJSON-377902434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:59 devstack sudo[87250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae Apr 10 10:37:59 devstack sudo[87250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:59 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] Flow 'volume_create_manager' (6f78a9a3-d43f-4500-8da8-46ceb292d9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (150c0899-7f23-48aa-bebe-dbc70cf330bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (150c0899-7f23-48aa-bebe-dbc70cf330bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-751484515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93855a4c-1749-4df3-97f2-5b2119f54d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2bd37788c64253ac091e9102e1a24a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:00Z,use_quota=True,user_id='145d2c5358394455a56c9859f18e4ca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf97714-28de-4857-9a06-b38dcd4ec833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf97714-28de-4857-9a06-b38dcd4ec833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:59 devstack sudo[87250]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d03c750-cde3-4433-a673-73d005b780a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d03c750-cde3-4433-a673-73d005b780a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93855a4c-1749-4df3-97f2-5b2119f54d6f', 'volume_name': 'volume-93855a4c-1749-4df3-97f2-5b2119f54d6f', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (272b2398-3cb5-4a05-b5d7-b2b255f1d4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (272b2398-3cb5-4a05-b5d7-b2b255f1d4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82c12ea-562e-4bb0-8b3e-2a2eaf4ad3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:59 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] Volume 93855a4c-1749-4df3-97f2-5b2119f54d6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93855a4c-1749-4df3-97f2-5b2119f54d6f', 'volume_size': 1} Apr 10 10:37:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6a0a2f23-cd6c-44da-b0aa-b3ee89c430f4 tempest-VolumesSnapshotListTestJSON-377902434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae" returned: 0 in 0.750s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:59 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-6a0a2f23-cd6c-44da-b0aa-b3ee89c430f4 tempest-VolumesSnapshotListTestJSON-377902434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-268815d6-e220-4379-9b72-1304ea1bf07e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:37:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6a0a2f23-cd6c-44da-b0aa-b3ee89c430f4 tempest-VolumesSnapshotListTestJSON-377902434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.0ba95d07-b116-4186-8a49-6d2387580be1 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:00 devstack sudo[87256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.0ba95d07-b116-4186-8a49-6d2387580be1 1G Apr 10 10:38:00 devstack sudo[87256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] Flow 'volume_create_manager' (ca4e6623-e69a-4f69-a7e5-6f02358a8d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f86114e9-ad6d-4621-90e3-7fd680aff9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f86114e9-ad6d-4621-90e3-7fd680aff9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1556861049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c425852d-89d5-4b04-9b09-503ff05f00a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2bd37788c64253ac091e9102e1a24a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:00Z,use_quota=True,user_id='145d2c5358394455a56c9859f18e4ca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3528185-4e62-40a3-9c7a-05c92c426dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3528185-4e62-40a3-9c7a-05c92c426dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a897d84f-07b9-4760-b42a-f0f6b8269166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a897d84f-07b9-4760-b42a-f0f6b8269166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c425852d-89d5-4b04-9b09-503ff05f00a1', 'volume_name': 'volume-c425852d-89d5-4b04-9b09-503ff05f00a1', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc8a9446-bcd2-47cd-9109-754ec3fbb75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc8a9446-bcd2-47cd-9109-754ec3fbb75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0579941b-358e-4dec-a2e7-27e287e3e58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:00 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] Volume c425852d-89d5-4b04-9b09-503ff05f00a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c425852d-89d5-4b04-9b09-503ff05f00a1', 'volume_size': 1} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] Flow 'volume_create_manager' (e0547c10-3957-4679-9b02-ba635aa57e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (250b7779-2312-4508-8565-73fb7095cd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (250b7779-2312-4508-8565-73fb7095cd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-345895103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc5d42f1-2277-4a9e-9652-2081a87f1dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2bd37788c64253ac091e9102e1a24a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:00Z,use_quota=True,user_id='145d2c5358394455a56c9859f18e4ca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4223950-3f0b-4b96-b747-feeea2034aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4223950-3f0b-4b96-b747-feeea2034aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (527935de-67e6-408a-88a2-ff211cecdefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (527935de-67e6-408a-88a2-ff211cecdefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc5d42f1-2277-4a9e-9652-2081a87f1dae', 'volume_name': 'volume-dc5d42f1-2277-4a9e-9652-2081a87f1dae', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0350ca64-8b62-4a35-9a81-86b58f781407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0350ca64-8b62-4a35-9a81-86b58f781407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a57b7762-4df9-4f09-9852-dc6a1739dae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:00 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] Volume dc5d42f1-2277-4a9e-9652-2081a87f1dae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc5d42f1-2277-4a9e-9652-2081a87f1dae', 'volume_size': 1} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] Flow 'volume_create_manager' (8af5f2f4-fd71-4934-8721-fe1d7d3fcd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2957b147-bfbb-460d-9476-c244ad1e3459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2957b147-bfbb-460d-9476-c244ad1e3459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2002245127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0bdbfea-8ea5-4574-86f4-d325d6b25dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2bd37788c64253ac091e9102e1a24a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:01Z,use_quota=True,user_id='145d2c5358394455a56c9859f18e4ca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec5b6220-fccd-48e4-83f8-f36993aa3cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec5b6220-fccd-48e4-83f8-f36993aa3cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31134f93-4129-49ee-9d9d-0a17ed8dfb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31134f93-4129-49ee-9d9d-0a17ed8dfb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0bdbfea-8ea5-4574-86f4-d325d6b25dab', 'volume_name': 'volume-c0bdbfea-8ea5-4574-86f4-d325d6b25dab', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c8dfe2f-0bea-4c94-871a-fc8297ed0fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c8dfe2f-0bea-4c94-871a-fc8297ed0fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af76de90-26f4-4359-920d-4e35d077de44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:00 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] Volume c0bdbfea-8ea5-4574-86f4-d325d6b25dab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0bdbfea-8ea5-4574-86f4-d325d6b25dab', 'volume_size': 1} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:00 devstack sudo[87256]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6a0a2f23-cd6c-44da-b0aa-b3ee89c430f4 tempest-VolumesSnapshotListTestJSON-377902434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.0ba95d07-b116-4186-8a49-6d2387580be1 1G" returned: 0 in 0.897s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6a0a2f23-cd6c-44da-b0aa-b3ee89c430f4 tempest-VolumesSnapshotListTestJSON-377902434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.0ba95d07-b116-4186-8a49-6d2387580be1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:00 devstack sudo[87286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.0ba95d07-b116-4186-8a49-6d2387580be1 Apr 10 10:38:00 devstack sudo[87286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:01 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] Flow 'volume_create_manager' (dca8e713-174e-4938-afbb-2986ec9019be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb14dad-b9bc-4502-82b2-83754fa5f67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb14dad-b9bc-4502-82b2-83754fa5f67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1497952421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=276eba67-dfbd-4650-93ef-514ebe513dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2bd37788c64253ac091e9102e1a24a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:01Z,use_quota=True,user_id='145d2c5358394455a56c9859f18e4ca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd4cc985-d279-46cf-a891-e1e74c782bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd4cc985-d279-46cf-a891-e1e74c782bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da75d54-b725-414e-a7e0-77b04b02d734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da75d54-b725-414e-a7e0-77b04b02d734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '276eba67-dfbd-4650-93ef-514ebe513dc1', 'volume_name': 'volume-276eba67-dfbd-4650-93ef-514ebe513dc1', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d62de04-a190-4de9-98df-2f25d6b09385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d62de04-a190-4de9-98df-2f25d6b09385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf25436-3f4a-4640-bfc7-e5fa9869f208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:01 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] Volume 276eba67-dfbd-4650-93ef-514ebe513dc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-276eba67-dfbd-4650-93ef-514ebe513dc1', 'volume_size': 1} Apr 10 10:38:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:01 devstack sudo[87286]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6a0a2f23-cd6c-44da-b0aa-b3ee89c430f4 tempest-VolumesSnapshotListTestJSON-377902434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.0ba95d07-b116-4186-8a49-6d2387580be1" returned: 0 in 0.604s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:01 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-6a0a2f23-cd6c-44da-b0aa-b3ee89c430f4 tempest-VolumesSnapshotListTestJSON-377902434 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.0ba95d07-b116-4186-8a49-6d2387580be1 is being set with open permissions: ugo+rw Apr 10 10:38:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6a0a2f23-cd6c-44da-b0aa-b3ee89c430f4 tempest-VolumesSnapshotListTestJSON-377902434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.0ba95d07-b116-4186-8a49-6d2387580be1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:01 devstack sudo[87292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.0ba95d07-b116-4186-8a49-6d2387580be1 Apr 10 10:38:01 devstack sudo[87292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:01 devstack sudo[87292]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6a0a2f23-cd6c-44da-b0aa-b3ee89c430f4 tempest-VolumesSnapshotListTestJSON-377902434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.0ba95d07-b116-4186-8a49-6d2387580be1" returned: 0 in 0.504s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6a0a2f23-cd6c-44da-b0aa-b3ee89c430f4 tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.844s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.285s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:02 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1387511534',display_name='tempest-VolumesGetTest-Volume-1694703587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ed864f-09a5-4667-9e14-c8ad4195d4f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69a9c60134b743c9856d1cc12e58ad43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:57Z,use_quota=True,user_id='99b2c59b40aa4ed6925ceb4e538b7ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:02 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] Creating volume b1ed864f-09a5-4667-9e14-c8ad4195d4f3 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:02 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:02 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:02 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:02 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:38:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b1ed864f-09a5-4667-9e14-c8ad4195d4f3 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:02 devstack sudo[87295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b1ed864f-09a5-4667-9e14-c8ad4195d4f3 1073741824 Apr 10 10:38:02 devstack sudo[87295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:02 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-6a0a2f23-cd6c-44da-b0aa-b3ee89c430f4 tempest-VolumesSnapshotListTestJSON-377902434 None] Create snapshot completed successfully Apr 10 10:38:02 devstack sudo[87295]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b1ed864f-09a5-4667-9e14-c8ad4195d4f3 1073741824" returned: 0 in 0.590s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b1ed864f-09a5-4667-9e14-c8ad4195d4f3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:02 devstack sudo[87301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b1ed864f-09a5-4667-9e14-c8ad4195d4f3 Apr 10 10:38:02 devstack sudo[87301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:03 devstack sudo[87301]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b1ed864f-09a5-4667-9e14-c8ad4195d4f3" returned: 0 in 0.482s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:03 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.169s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:03 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-751484515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93855a4c-1749-4df3-97f2-5b2119f54d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2bd37788c64253ac091e9102e1a24a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:00Z,use_quota=True,user_id='145d2c5358394455a56c9859f18e4ca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:03 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] Creating volume 93855a4c-1749-4df3-97f2-5b2119f54d6f {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:03 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:03 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:03 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:03 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:38:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-93855a4c-1749-4df3-97f2-5b2119f54d6f 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:03 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb44f42-1948-4252-97d5-d59edc1a5be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1ed864f-09a5-4667-9e14-c8ad4195d4f3', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:03 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d88222fa-b75d-4d19-8b6f-ad1295f3c631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:03 devstack sudo[87304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-93855a4c-1749-4df3-97f2-5b2119f54d6f 1073741824 Apr 10 10:38:03 devstack sudo[87304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:03 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] Volume volume-b1ed864f-09a5-4667-9e14-c8ad4195d4f3 (b1ed864f-09a5-4667-9e14-c8ad4195d4f3): created successfully Apr 10 10:38:03 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d88222fa-b75d-4d19-8b6f-ad1295f3c631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:03 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] Flow 'volume_create_manager' (e6416d92-0678-491f-bb1d-1eed4ab28fcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:03 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-5760e9e8-af67-482e-8e25-2be479d6d52a tempest-VolumesGetTest-1117816825 None] Created volume successfully. Apr 10 10:38:03 devstack sudo[87304]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-93855a4c-1749-4df3-97f2-5b2119f54d6f 1073741824" returned: 0 in 0.682s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:03 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e888f219-156f-4d0c-b821-9bec58f16420 tempest-VolumesSnapshotListTestJSON-377902434 None] Acquiring lock "cinder-0ba95d07-b116-4186-8a49-6d2387580be1-delete_snapshot" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:03 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e888f219-156f-4d0c-b821-9bec58f16420 tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "cinder-0ba95d07-b116-4186-8a49-6d2387580be1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:03 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e888f219-156f-4d0c-b821-9bec58f16420 tempest-VolumesSnapshotListTestJSON-377902434 None] Acquiring lock "cinder-quobyte-268815d6-e220-4379-9b72-1304ea1bf07e" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-93855a4c-1749-4df3-97f2-5b2119f54d6f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:03 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e888f219-156f-4d0c-b821-9bec58f16420 tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "cinder-quobyte-268815d6-e220-4379-9b72-1304ea1bf07e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:03 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e888f219-156f-4d0c-b821-9bec58f16420 tempest-VolumesSnapshotListTestJSON-377902434 None] Acquiring lock "cinder-quobyte-0ba95d07-b116-4186-8a49-6d2387580be1" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:03 devstack sudo[87309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-93855a4c-1749-4df3-97f2-5b2119f54d6f Apr 10 10:38:03 devstack sudo[87309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:03 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e888f219-156f-4d0c-b821-9bec58f16420 tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "cinder-quobyte-0ba95d07-b116-4186-8a49-6d2387580be1" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:03 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-e888f219-156f-4d0c-b821-9bec58f16420 tempest-VolumesSnapshotListTestJSON-377902434 None] Deleting offline snapshot 0ba95d07-b116-4186-8a49-6d2387580be1 of volume 268815d6-e220-4379-9b72-1304ea1bf07e {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:38:03 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-e888f219-156f-4d0c-b821-9bec58f16420 tempest-VolumesSnapshotListTestJSON-377902434 None] snapshot_file for this snap is: volume-268815d6-e220-4379-9b72-1304ea1bf07e.0ba95d07-b116-4186-8a49-6d2387580be1 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:38:03 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[65813db2-23d7-45a7-a08d-ce47f4284f1e]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e888f219-156f-4d0c-b821-9bec58f16420 tempest-VolumesSnapshotListTestJSON-377902434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.0ba95d07-b116-4186-8a49-6d2387580be1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:04 devstack sudo[87311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.0ba95d07-b116-4186-8a49-6d2387580be1 Apr 10 10:38:04 devstack sudo[87311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:04 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-9e8f4573-48a4-4c24-86a7-2efcca1ed509 tempest-VolumesGetTest-1117816825 None] Acquiring lock "cinder-b1ed864f-09a5-4667-9e14-c8ad4195d4f3-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:04 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-9e8f4573-48a4-4c24-86a7-2efcca1ed509 tempest-VolumesGetTest-1117816825 None] Lock "cinder-b1ed864f-09a5-4667-9e14-c8ad4195d4f3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:04 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-9e8f4573-48a4-4c24-86a7-2efcca1ed509 tempest-VolumesGetTest-1117816825 None] Acquiring lock "cinder-quobyte-b1ed864f-09a5-4667-9e14-c8ad4195d4f3" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:04 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-9e8f4573-48a4-4c24-86a7-2efcca1ed509 tempest-VolumesGetTest-1117816825 None] Lock "cinder-quobyte-b1ed864f-09a5-4667-9e14-c8ad4195d4f3" acquired by "delete_volume" :: waited 0.015s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:04 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76c200d-3370-40e2-bd7f-df9fb8f71230]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9e8f4573-48a4-4c24-86a7-2efcca1ed509 tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b1ed864f-09a5-4667-9e14-c8ad4195d4f3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:04 devstack sudo[87313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b1ed864f-09a5-4667-9e14-c8ad4195d4f3 Apr 10 10:38:04 devstack sudo[87313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:04 devstack sudo[87309]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-93855a4c-1749-4df3-97f2-5b2119f54d6f" returned: 0 in 0.671s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:04 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] <== create_volume: return (1412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.365s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:04 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1556861049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c425852d-89d5-4b04-9b09-503ff05f00a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2bd37788c64253ac091e9102e1a24a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:00Z,use_quota=True,user_id='145d2c5358394455a56c9859f18e4ca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:04 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] Creating volume c425852d-89d5-4b04-9b09-503ff05f00a1 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:04 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:04 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:04 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:04 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:38:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c425852d-89d5-4b04-9b09-503ff05f00a1 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:04 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82c12ea-562e-4bb0-8b3e-2a2eaf4ad3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93855a4c-1749-4df3-97f2-5b2119f54d6f', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:04 devstack sudo[87311]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:04 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edc652d4-4f94-4ea9-82cb-badecf143912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:04 devstack sudo[87319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c425852d-89d5-4b04-9b09-503ff05f00a1 1073741824 Apr 10 10:38:04 devstack sudo[87319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e888f219-156f-4d0c-b821-9bec58f16420 tempest-VolumesSnapshotListTestJSON-377902434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.0ba95d07-b116-4186-8a49-6d2387580be1" returned: 0 in 0.665s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:04 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-e888f219-156f-4d0c-b821-9bec58f16420 tempest-VolumesSnapshotListTestJSON-377902434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-268815d6-e220-4379-9b72-1304ea1bf07e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:04 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0aee76-acfd-4513-b741-955a99fb15c7]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e888f219-156f-4d0c-b821-9bec58f16420 tempest-VolumesSnapshotListTestJSON-377902434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:04 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] Volume volume-93855a4c-1749-4df3-97f2-5b2119f54d6f (93855a4c-1749-4df3-97f2-5b2119f54d6f): created successfully Apr 10 10:38:04 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edc652d4-4f94-4ea9-82cb-badecf143912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:04 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] Flow 'volume_create_manager' (6f78a9a3-d43f-4500-8da8-46ceb292d9e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:04 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-f00e2c9a-2845-483f-bed4-698076176a01 tempest-CreateVolumesFromSnapshotTest-722925440 None] Created volume successfully. Apr 10 10:38:04 devstack sudo[87321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae Apr 10 10:38:04 devstack sudo[87321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:05 devstack sudo[87313]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9e8f4573-48a4-4c24-86a7-2efcca1ed509 tempest-VolumesGetTest-1117816825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b1ed864f-09a5-4667-9e14-c8ad4195d4f3" returned: 0 in 0.659s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9e8f4573-48a4-4c24-86a7-2efcca1ed509 tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b1ed864f-09a5-4667-9e14-c8ad4195d4f3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:05 devstack sudo[87326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b1ed864f-09a5-4667-9e14-c8ad4195d4f3 Apr 10 10:38:05 devstack sudo[87326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:05 devstack sudo[87319]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c425852d-89d5-4b04-9b09-503ff05f00a1 1073741824" returned: 0 in 0.715s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c425852d-89d5-4b04-9b09-503ff05f00a1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:05 devstack sudo[87321]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e888f219-156f-4d0c-b821-9bec58f16420 tempest-VolumesSnapshotListTestJSON-377902434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae" returned: 0 in 0.708s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-e888f219-156f-4d0c-b821-9bec58f16420 tempest-VolumesSnapshotListTestJSON-377902434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-268815d6-e220-4379-9b72-1304ea1bf07e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e888f219-156f-4d0c-b821-9bec58f16420 tempest-VolumesSnapshotListTestJSON-377902434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.0ba95d07-b116-4186-8a49-6d2387580be1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:05 devstack sudo[87334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c425852d-89d5-4b04-9b09-503ff05f00a1 Apr 10 10:38:05 devstack sudo[87334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:05 devstack sudo[87335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.0ba95d07-b116-4186-8a49-6d2387580be1 Apr 10 10:38:05 devstack sudo[87335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:05 devstack sudo[87326]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9e8f4573-48a4-4c24-86a7-2efcca1ed509 tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b1ed864f-09a5-4667-9e14-c8ad4195d4f3" returned: 0 in 0.598s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-9e8f4573-48a4-4c24-86a7-2efcca1ed509 tempest-VolumesGetTest-1117816825 None] Lock "cinder-quobyte-b1ed864f-09a5-4667-9e14-c8ad4195d4f3" released by "delete_volume" :: held 1.294s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-9e8f4573-48a4-4c24-86a7-2efcca1ed509 tempest-VolumesGetTest-1117816825 None] Created reservations ['02192714-17f1-44fa-82b8-6735560d2c7b', '40e2c519-992a-4ea5-8747-85fcc5b9f7f4', '8c42dab6-fc98-4398-bdcb-f081538184ba', '6bce44f0-03b1-46f8-be0b-6ac3a8f3cf95'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-9e8f4573-48a4-4c24-86a7-2efcca1ed509 tempest-VolumesGetTest-1117816825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-9e8f4573-48a4-4c24-86a7-2efcca1ed509 tempest-VolumesGetTest-1117816825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-9e8f4573-48a4-4c24-86a7-2efcca1ed509 tempest-VolumesGetTest-1117816825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-9e8f4573-48a4-4c24-86a7-2efcca1ed509 tempest-VolumesGetTest-1117816825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-9e8f4573-48a4-4c24-86a7-2efcca1ed509 tempest-VolumesGetTest-1117816825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9e8f4573-48a4-4c24-86a7-2efcca1ed509 tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:05 devstack sudo[87339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:38:05 devstack sudo[87339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:05 devstack sudo[87334]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c425852d-89d5-4b04-9b09-503ff05f00a1" returned: 0 in 0.589s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] <== create_volume: return (1342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.345s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.470s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-345895103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc5d42f1-2277-4a9e-9652-2081a87f1dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2bd37788c64253ac091e9102e1a24a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:00Z,use_quota=True,user_id='145d2c5358394455a56c9859f18e4ca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] Creating volume dc5d42f1-2277-4a9e-9652-2081a87f1dae {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:05 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dc5d42f1-2277-4a9e-9652-2081a87f1dae 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0579941b-358e-4dec-a2e7-27e287e3e58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c425852d-89d5-4b04-9b09-503ff05f00a1', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f1b3a6-7b37-4747-868e-19c662eaa26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:05 devstack sudo[87335]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e888f219-156f-4d0c-b821-9bec58f16420 tempest-VolumesSnapshotListTestJSON-377902434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.0ba95d07-b116-4186-8a49-6d2387580be1" returned: 0 in 0.654s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e888f219-156f-4d0c-b821-9bec58f16420 tempest-VolumesSnapshotListTestJSON-377902434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.0ba95d07-b116-4186-8a49-6d2387580be1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:06 devstack sudo[87345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dc5d42f1-2277-4a9e-9652-2081a87f1dae 1073741824 Apr 10 10:38:06 devstack sudo[87345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:06 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] Volume volume-c425852d-89d5-4b04-9b09-503ff05f00a1 (c425852d-89d5-4b04-9b09-503ff05f00a1): created successfully Apr 10 10:38:06 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f1b3a6-7b37-4747-868e-19c662eaa26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:06 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] Flow 'volume_create_manager' (ca4e6623-e69a-4f69-a7e5-6f02358a8d8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:06 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-88178830-48ae-4336-bbf8-6d3c104496c7 tempest-CreateVolumesFromSnapshotTest-722925440 None] Created volume successfully. Apr 10 10:38:06 devstack sudo[87346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.0ba95d07-b116-4186-8a49-6d2387580be1 Apr 10 10:38:06 devstack sudo[87346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:06 devstack sudo[87339]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9e8f4573-48a4-4c24-86a7-2efcca1ed509 tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.579s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:06 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-9e8f4573-48a4-4c24-86a7-2efcca1ed509 tempest-VolumesGetTest-1117816825 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:06 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-9e8f4573-48a4-4c24-86a7-2efcca1ed509 tempest-VolumesGetTest-1117816825 None] Deleted volume successfully. Apr 10 10:38:06 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-9e8f4573-48a4-4c24-86a7-2efcca1ed509 tempest-VolumesGetTest-1117816825 None] Lock "cinder-b1ed864f-09a5-4667-9e14-c8ad4195d4f3-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:06 devstack sudo[87346]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:06 devstack sudo[87345]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e888f219-156f-4d0c-b821-9bec58f16420 tempest-VolumesSnapshotListTestJSON-377902434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.0ba95d07-b116-4186-8a49-6d2387580be1" returned: 0 in 0.643s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dc5d42f1-2277-4a9e-9652-2081a87f1dae 1073741824" returned: 0 in 0.708s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:06 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e888f219-156f-4d0c-b821-9bec58f16420 tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "cinder-quobyte-0ba95d07-b116-4186-8a49-6d2387580be1" released by "_delete_snapshot" :: held 2.752s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:06 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e888f219-156f-4d0c-b821-9bec58f16420 tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "cinder-quobyte-268815d6-e220-4379-9b72-1304ea1bf07e" released by "delete_snapshot" :: held 2.776s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:06 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-e888f219-156f-4d0c-b821-9bec58f16420 tempest-VolumesSnapshotListTestJSON-377902434 None] Created reservations ['76381472-9f90-4d11-b7a1-6a78d5b0aa52', '80c01a50-8e32-4acc-af90-76e36b6ce28a', 'f20f0c1a-cac7-4453-be92-18f94746c0c5', '9688745e-1049-403f-996c-bf7cc128a493'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dc5d42f1-2277-4a9e-9652-2081a87f1dae {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:06 devstack sudo[87354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dc5d42f1-2277-4a9e-9652-2081a87f1dae Apr 10 10:38:06 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-1e474663-ad34-4170-9210-69da05e737c4 tempest-VolumesGetTest-1117816825 None] Acquiring lock "cinder-c0619404-125f-4eed-b10e-5369be9eb298-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:06 devstack sudo[87354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:06 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-1e474663-ad34-4170-9210-69da05e737c4 tempest-VolumesGetTest-1117816825 None] Lock "cinder-c0619404-125f-4eed-b10e-5369be9eb298-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:06 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-1e474663-ad34-4170-9210-69da05e737c4 tempest-VolumesGetTest-1117816825 None] Acquiring lock "cinder-quobyte-c0619404-125f-4eed-b10e-5369be9eb298" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:06 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-1e474663-ad34-4170-9210-69da05e737c4 tempest-VolumesGetTest-1117816825 None] Lock "cinder-quobyte-c0619404-125f-4eed-b10e-5369be9eb298" acquired by "delete_volume" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:06 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-e888f219-156f-4d0c-b821-9bec58f16420 tempest-VolumesSnapshotListTestJSON-377902434 None] Delete snapshot completed successfully. Apr 10 10:38:06 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2fb6b8-6d8a-4ee3-8add-3f81c19eee8d]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1e474663-ad34-4170-9210-69da05e737c4 tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0619404-125f-4eed-b10e-5369be9eb298 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:06 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e888f219-156f-4d0c-b821-9bec58f16420 tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "cinder-0ba95d07-b116-4186-8a49-6d2387580be1-delete_snapshot" released by "delete_snapshot" :: held 2.980s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:06 devstack sudo[87356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0619404-125f-4eed-b10e-5369be9eb298 Apr 10 10:38:06 devstack sudo[87356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-26425290-3250-4a0c-9016-1d24ab0c9d7c tempest-VolumesSnapshotListTestJSON-377902434 None] Acquiring lock "cinder-a9c00a40-4a42-4803-b492-3dd5c356f8ae-delete_snapshot" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-26425290-3250-4a0c-9016-1d24ab0c9d7c tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "cinder-a9c00a40-4a42-4803-b492-3dd5c356f8ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-26425290-3250-4a0c-9016-1d24ab0c9d7c tempest-VolumesSnapshotListTestJSON-377902434 None] Acquiring lock "cinder-quobyte-268815d6-e220-4379-9b72-1304ea1bf07e" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-26425290-3250-4a0c-9016-1d24ab0c9d7c tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "cinder-quobyte-268815d6-e220-4379-9b72-1304ea1bf07e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-26425290-3250-4a0c-9016-1d24ab0c9d7c tempest-VolumesSnapshotListTestJSON-377902434 None] Acquiring lock "cinder-quobyte-a9c00a40-4a42-4803-b492-3dd5c356f8ae" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-26425290-3250-4a0c-9016-1d24ab0c9d7c tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "cinder-quobyte-a9c00a40-4a42-4803-b492-3dd5c356f8ae" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-26425290-3250-4a0c-9016-1d24ab0c9d7c tempest-VolumesSnapshotListTestJSON-377902434 None] Deleting offline snapshot a9c00a40-4a42-4803-b492-3dd5c356f8ae of volume 268815d6-e220-4379-9b72-1304ea1bf07e {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-26425290-3250-4a0c-9016-1d24ab0c9d7c tempest-VolumesSnapshotListTestJSON-377902434 None] snapshot_file for this snap is: volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6531c89-704b-4222-9873-43f64f8344a8]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-26425290-3250-4a0c-9016-1d24ab0c9d7c tempest-VolumesSnapshotListTestJSON-377902434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:07 devstack sudo[87358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae Apr 10 10:38:07 devstack sudo[87358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:07 devstack sudo[87354]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dc5d42f1-2277-4a9e-9652-2081a87f1dae" returned: 0 in 0.511s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.452s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2002245127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0bdbfea-8ea5-4574-86f4-d325d6b25dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2bd37788c64253ac091e9102e1a24a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:01Z,use_quota=True,user_id='145d2c5358394455a56c9859f18e4ca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] Creating volume c0bdbfea-8ea5-4574-86f4-d325d6b25dab {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:07 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0bdbfea-8ea5-4574-86f4-d325d6b25dab 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a57b7762-4df9-4f09-9852-dc6a1739dae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc5d42f1-2277-4a9e-9652-2081a87f1dae', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:07 devstack sudo[87361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0bdbfea-8ea5-4574-86f4-d325d6b25dab 1073741824 Apr 10 10:38:07 devstack sudo[87361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6706132c-3ad5-4f6a-82c8-5b4bc914c64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:07 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] Volume volume-dc5d42f1-2277-4a9e-9652-2081a87f1dae (dc5d42f1-2277-4a9e-9652-2081a87f1dae): created successfully Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6706132c-3ad5-4f6a-82c8-5b4bc914c64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] Flow 'volume_create_manager' (e0547c10-3957-4679-9b02-ba635aa57e9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:07 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-124660f1-343d-4568-a0bf-121d6c1911f9 tempest-CreateVolumesFromSnapshotTest-722925440 None] Created volume successfully. Apr 10 10:38:07 devstack sudo[87356]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1e474663-ad34-4170-9210-69da05e737c4 tempest-VolumesGetTest-1117816825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0619404-125f-4eed-b10e-5369be9eb298" returned: 0 in 0.618s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1e474663-ad34-4170-9210-69da05e737c4 tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0619404-125f-4eed-b10e-5369be9eb298 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:07 devstack sudo[87366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0619404-125f-4eed-b10e-5369be9eb298 Apr 10 10:38:07 devstack sudo[87366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:07 devstack sudo[87358]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-26425290-3250-4a0c-9016-1d24ab0c9d7c tempest-VolumesSnapshotListTestJSON-377902434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae" returned: 0 in 0.611s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-26425290-3250-4a0c-9016-1d24ab0c9d7c tempest-VolumesSnapshotListTestJSON-377902434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-268815d6-e220-4379-9b72-1304ea1bf07e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e13002f-e1e3-4feb-8b47-db60bdad20a3]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-26425290-3250-4a0c-9016-1d24ab0c9d7c tempest-VolumesSnapshotListTestJSON-377902434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:07 devstack sudo[87361]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:07 devstack sudo[87374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1 Apr 10 10:38:07 devstack sudo[87374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0bdbfea-8ea5-4574-86f4-d325d6b25dab 1073741824" returned: 0 in 0.553s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0bdbfea-8ea5-4574-86f4-d325d6b25dab {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:07 devstack sudo[87376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0bdbfea-8ea5-4574-86f4-d325d6b25dab Apr 10 10:38:07 devstack sudo[87376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:07 devstack sudo[87366]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1e474663-ad34-4170-9210-69da05e737c4 tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0619404-125f-4eed-b10e-5369be9eb298" returned: 0 in 0.524s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:07 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-1e474663-ad34-4170-9210-69da05e737c4 tempest-VolumesGetTest-1117816825 None] Lock "cinder-quobyte-c0619404-125f-4eed-b10e-5369be9eb298" released by "delete_volume" :: held 1.167s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-1e474663-ad34-4170-9210-69da05e737c4 tempest-VolumesGetTest-1117816825 None] Created reservations ['cab304a5-c737-49ab-9fc6-c05cd944c0dc', 'ade129d9-b846-4e85-a889-f8cfcadf16f4', 'ce433afc-6c76-45b7-b898-1b2c02b38220', '57e240ca-23a1-447d-96e7-8aecc0333f13'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1e474663-ad34-4170-9210-69da05e737c4 tempest-VolumesGetTest-1117816825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1e474663-ad34-4170-9210-69da05e737c4 tempest-VolumesGetTest-1117816825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1e474663-ad34-4170-9210-69da05e737c4 tempest-VolumesGetTest-1117816825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1e474663-ad34-4170-9210-69da05e737c4 tempest-VolumesGetTest-1117816825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1e474663-ad34-4170-9210-69da05e737c4 tempest-VolumesGetTest-1117816825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1e474663-ad34-4170-9210-69da05e737c4 tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:08 devstack sudo[87379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:38:08 devstack sudo[87379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:08 devstack sudo[87374]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-26425290-3250-4a0c-9016-1d24ab0c9d7c tempest-VolumesSnapshotListTestJSON-377902434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1" returned: 0 in 0.571s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-26425290-3250-4a0c-9016-1d24ab0c9d7c tempest-VolumesSnapshotListTestJSON-377902434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-268815d6-e220-4379-9b72-1304ea1bf07e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-26425290-3250-4a0c-9016-1d24ab0c9d7c tempest-VolumesSnapshotListTestJSON-377902434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:08 devstack sudo[87385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae Apr 10 10:38:08 devstack sudo[87385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:08 devstack sudo[87376]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0bdbfea-8ea5-4574-86f4-d325d6b25dab" returned: 0 in 0.539s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.303s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1497952421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=276eba67-dfbd-4650-93ef-514ebe513dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca2bd37788c64253ac091e9102e1a24a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:01Z,use_quota=True,user_id='145d2c5358394455a56c9859f18e4ca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] Creating volume 276eba67-dfbd-4650-93ef-514ebe513dc1 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:08 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-276eba67-dfbd-4650-93ef-514ebe513dc1 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af76de90-26f4-4359-920d-4e35d077de44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0bdbfea-8ea5-4574-86f4-d325d6b25dab', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce195ca5-5d31-4e3f-8ae9-8afd0a03133e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:08 devstack sudo[87387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-276eba67-dfbd-4650-93ef-514ebe513dc1 1073741824 Apr 10 10:38:08 devstack sudo[87387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:08 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] Volume volume-c0bdbfea-8ea5-4574-86f4-d325d6b25dab (c0bdbfea-8ea5-4574-86f4-d325d6b25dab): created successfully Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce195ca5-5d31-4e3f-8ae9-8afd0a03133e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] Flow 'volume_create_manager' (8af5f2f4-fd71-4934-8721-fe1d7d3fcd65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:08 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-8e9e73b2-a9e4-465c-8118-47af2a635aed tempest-CreateVolumesFromSnapshotTest-722925440 None] Created volume successfully. Apr 10 10:38:08 devstack sudo[87379]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1e474663-ad34-4170-9210-69da05e737c4 tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.466s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-1e474663-ad34-4170-9210-69da05e737c4 tempest-VolumesGetTest-1117816825 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:08 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-1e474663-ad34-4170-9210-69da05e737c4 tempest-VolumesGetTest-1117816825 None] Deleted volume successfully. Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-1e474663-ad34-4170-9210-69da05e737c4 tempest-VolumesGetTest-1117816825 None] Lock "cinder-c0619404-125f-4eed-b10e-5369be9eb298-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:08 devstack sudo[87385]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-26425290-3250-4a0c-9016-1d24ab0c9d7c tempest-VolumesSnapshotListTestJSON-377902434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae" returned: 0 in 0.572s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-26425290-3250-4a0c-9016-1d24ab0c9d7c tempest-VolumesSnapshotListTestJSON-377902434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:08 devstack sudo[87396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae Apr 10 10:38:08 devstack sudo[87396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:08 devstack sudo[87387]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-276eba67-dfbd-4650-93ef-514ebe513dc1 1073741824" returned: 0 in 0.581s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-276eba67-dfbd-4650-93ef-514ebe513dc1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:09 devstack sudo[87398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-276eba67-dfbd-4650-93ef-514ebe513dc1 Apr 10 10:38:09 devstack sudo[87398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] Flow 'volume_create_manager' (33bf3148-0814-442c-bc4e-9252aa65c7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf81fb9-be54-48ac-a2c8-42363b879baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf81fb9-be54-48ac-a2c8-42363b879baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-404654500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5be19908-f9d7-4953-927d-ece7e92ab2cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69a9c60134b743c9856d1cc12e58ad43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:09Z,use_quota=True,user_id='99b2c59b40aa4ed6925ceb4e538b7ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf7580c-abd8-477e-a584-687f24b8217e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf7580c-abd8-477e-a584-687f24b8217e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f76f6a27-be41-4da7-8eae-c8c2c3862bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f76f6a27-be41-4da7-8eae-c8c2c3862bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5be19908-f9d7-4953-927d-ece7e92ab2cd', 'volume_name': 'volume-5be19908-f9d7-4953-927d-ece7e92ab2cd', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a150d2d-8073-4481-9d6e-54d1f379206c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a150d2d-8073-4481-9d6e-54d1f379206c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2321db3-521b-42e9-98e5-2f80b0bae37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:09 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] Volume 5be19908-f9d7-4953-927d-ece7e92ab2cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5be19908-f9d7-4953-927d-ece7e92ab2cd', 'volume_size': 1} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:09 devstack sudo[87396]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-26425290-3250-4a0c-9016-1d24ab0c9d7c tempest-VolumesSnapshotListTestJSON-377902434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.a9c00a40-4a42-4803-b492-3dd5c356f8ae" returned: 0 in 0.505s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-26425290-3250-4a0c-9016-1d24ab0c9d7c tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "cinder-quobyte-a9c00a40-4a42-4803-b492-3dd5c356f8ae" released by "_delete_snapshot" :: held 2.319s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-26425290-3250-4a0c-9016-1d24ab0c9d7c tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "cinder-quobyte-268815d6-e220-4379-9b72-1304ea1bf07e" released by "delete_snapshot" :: held 2.335s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-26425290-3250-4a0c-9016-1d24ab0c9d7c tempest-VolumesSnapshotListTestJSON-377902434 None] Created reservations ['d603275f-c53d-4486-bef2-cfc4caea38be', '9970d254-37fa-41d4-98bd-9fb9711da34c', '77d7755f-77d5-4741-8e9c-c635a30de217', 'd4ad86f9-c364-4a2a-9f57-b2aa1cd9630a'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:09 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-26425290-3250-4a0c-9016-1d24ab0c9d7c tempest-VolumesSnapshotListTestJSON-377902434 None] Delete snapshot completed successfully. Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-26425290-3250-4a0c-9016-1d24ab0c9d7c tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "cinder-a9c00a40-4a42-4803-b492-3dd5c356f8ae-delete_snapshot" released by "delete_snapshot" :: held 2.437s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:09 devstack sudo[87398]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-276eba67-dfbd-4650-93ef-514ebe513dc1" returned: 0 in 0.525s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.203s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-404654500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5be19908-f9d7-4953-927d-ece7e92ab2cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69a9c60134b743c9856d1cc12e58ad43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:09Z,use_quota=True,user_id='99b2c59b40aa4ed6925ceb4e538b7ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] Creating volume 5be19908-f9d7-4953-927d-ece7e92ab2cd {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:09 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:09 devstack sudo[87402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd 1073741824 Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf25436-3f4a-4640-bfc7-e5fa9869f208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-276eba67-dfbd-4650-93ef-514ebe513dc1', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:09 devstack sudo[87402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20943397-044b-4b4f-a3a8-5552b6990ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:09 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] Volume volume-276eba67-dfbd-4650-93ef-514ebe513dc1 (276eba67-dfbd-4650-93ef-514ebe513dc1): created successfully Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20943397-044b-4b4f-a3a8-5552b6990ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] Flow 'volume_create_manager' (dca8e713-174e-4938-afbb-2986ec9019be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:09 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-f9bded4e-2190-4b1c-add0-aceb709b3950 tempest-CreateVolumesFromSnapshotTest-722925440 None] Created volume successfully. Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f3616b67-a458-45b9-902a-97d1775e740f tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "cinder-276eba67-dfbd-4650-93ef-514ebe513dc1-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f3616b67-a458-45b9-902a-97d1775e740f tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "cinder-276eba67-dfbd-4650-93ef-514ebe513dc1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f3616b67-a458-45b9-902a-97d1775e740f tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "cinder-quobyte-276eba67-dfbd-4650-93ef-514ebe513dc1" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f3616b67-a458-45b9-902a-97d1775e740f tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "cinder-quobyte-276eba67-dfbd-4650-93ef-514ebe513dc1" acquired by "delete_volume" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[f170cdb7-cb46-4092-b275-797e37604543]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f3616b67-a458-45b9-902a-97d1775e740f tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-276eba67-dfbd-4650-93ef-514ebe513dc1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:09 devstack sudo[87404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-276eba67-dfbd-4650-93ef-514ebe513dc1 Apr 10 10:38:09 devstack sudo[87404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:10 devstack sudo[87402]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd 1073741824" returned: 0 in 0.547s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:10 devstack sudo[87410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd Apr 10 10:38:10 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:10 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a48d0623-b69a-48dc-8f96-cac9b67959c5 tempest-VolumesSnapshotListTestJSON-377902434 None] Acquiring lock "cinder-3f55acfb-e52e-472c-b826-8633d1212aa1-delete_snapshot" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:10 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a48d0623-b69a-48dc-8f96-cac9b67959c5 tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "cinder-3f55acfb-e52e-472c-b826-8633d1212aa1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:10 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a48d0623-b69a-48dc-8f96-cac9b67959c5 tempest-VolumesSnapshotListTestJSON-377902434 None] Acquiring lock "cinder-quobyte-268815d6-e220-4379-9b72-1304ea1bf07e" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:10 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a48d0623-b69a-48dc-8f96-cac9b67959c5 tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "cinder-quobyte-268815d6-e220-4379-9b72-1304ea1bf07e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:10 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a48d0623-b69a-48dc-8f96-cac9b67959c5 tempest-VolumesSnapshotListTestJSON-377902434 None] Acquiring lock "cinder-quobyte-3f55acfb-e52e-472c-b826-8633d1212aa1" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:10 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a48d0623-b69a-48dc-8f96-cac9b67959c5 tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "cinder-quobyte-3f55acfb-e52e-472c-b826-8633d1212aa1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:10 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-a48d0623-b69a-48dc-8f96-cac9b67959c5 tempest-VolumesSnapshotListTestJSON-377902434 None] Deleting offline snapshot 3f55acfb-e52e-472c-b826-8633d1212aa1 of volume 268815d6-e220-4379-9b72-1304ea1bf07e {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:38:10 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-a48d0623-b69a-48dc-8f96-cac9b67959c5 tempest-VolumesSnapshotListTestJSON-377902434 None] snapshot_file for this snap is: volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:38:10 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2088af-8a37-4026-89b5-8bc0740b1d43]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a48d0623-b69a-48dc-8f96-cac9b67959c5 tempest-VolumesSnapshotListTestJSON-377902434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:10 devstack sudo[87414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1 Apr 10 10:38:10 devstack sudo[87414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:10 devstack sudo[87404]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f3616b67-a458-45b9-902a-97d1775e740f tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-276eba67-dfbd-4650-93ef-514ebe513dc1" returned: 0 in 0.557s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f3616b67-a458-45b9-902a-97d1775e740f tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-276eba67-dfbd-4650-93ef-514ebe513dc1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:10 devstack sudo[87417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-276eba67-dfbd-4650-93ef-514ebe513dc1 Apr 10 10:38:10 devstack sudo[87417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:10 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd" returned: 0 in 0.495s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:10 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2321db3-521b-42e9-98e5-2f80b0bae37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5be19908-f9d7-4953-927d-ece7e92ab2cd', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2cdeafa-27f2-4986-a4c0-9f0ffd7fba3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:10 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] Volume volume-5be19908-f9d7-4953-927d-ece7e92ab2cd (5be19908-f9d7-4953-927d-ece7e92ab2cd): created successfully Apr 10 10:38:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2cdeafa-27f2-4986-a4c0-9f0ffd7fba3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] Flow 'volume_create_manager' (33bf3148-0814-442c-bc4e-9252aa65c7f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:10 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-7a325092-9ab7-45c1-9d48-882098377cb5 tempest-VolumesGetTest-1117816825 None] Created volume successfully. Apr 10 10:38:10 devstack sudo[87414]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a48d0623-b69a-48dc-8f96-cac9b67959c5 tempest-VolumesSnapshotListTestJSON-377902434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1" returned: 0 in 0.571s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:10 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-a48d0623-b69a-48dc-8f96-cac9b67959c5 tempest-VolumesSnapshotListTestJSON-377902434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-268815d6-e220-4379-9b72-1304ea1bf07e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:10 devstack sudo[87417]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:10 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5f4eaf-efa0-4432-b37b-b515ed94f5b1]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a48d0623-b69a-48dc-8f96-cac9b67959c5 tempest-VolumesSnapshotListTestJSON-377902434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f3616b67-a458-45b9-902a-97d1775e740f tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-276eba67-dfbd-4650-93ef-514ebe513dc1" returned: 0 in 0.498s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:10 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f3616b67-a458-45b9-902a-97d1775e740f tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "cinder-quobyte-276eba67-dfbd-4650-93ef-514ebe513dc1" released by "delete_volume" :: held 1.100s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:11 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-f3616b67-a458-45b9-902a-97d1775e740f tempest-CreateVolumesFromSnapshotTest-722925440 None] Created reservations ['d4af0e56-d9aa-4bcc-bf20-13fa218ae51d', 'bef0b231-1dcc-40b9-a939-111d6b9e2864', 'ed9c3a6e-8b04-419e-9767-673f2f836971', '4dc58805-3691-44d5-8d48-5e172243bcf6'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:11 devstack sudo[87424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e Apr 10 10:38:11 devstack sudo[87424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f3616b67-a458-45b9-902a-97d1775e740f tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f3616b67-a458-45b9-902a-97d1775e740f tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:11 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f3616b67-a458-45b9-902a-97d1775e740f tempest-CreateVolumesFromSnapshotTest-722925440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:11 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f3616b67-a458-45b9-902a-97d1775e740f tempest-CreateVolumesFromSnapshotTest-722925440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f3616b67-a458-45b9-902a-97d1775e740f tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f3616b67-a458-45b9-902a-97d1775e740f tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:11 devstack sudo[87426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:38:11 devstack sudo[87426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:11 devstack sudo[87424]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a48d0623-b69a-48dc-8f96-cac9b67959c5 tempest-VolumesSnapshotListTestJSON-377902434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e" returned: 0 in 0.711s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a48d0623-b69a-48dc-8f96-cac9b67959c5 tempest-VolumesSnapshotListTestJSON-377902434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:11 devstack sudo[87432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1 Apr 10 10:38:11 devstack sudo[87432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:11 devstack sudo[87426]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f3616b67-a458-45b9-902a-97d1775e740f tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.623s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:11 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-f3616b67-a458-45b9-902a-97d1775e740f tempest-CreateVolumesFromSnapshotTest-722925440 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:11 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-f3616b67-a458-45b9-902a-97d1775e740f tempest-CreateVolumesFromSnapshotTest-722925440 None] Deleted volume successfully. Apr 10 10:38:11 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f3616b67-a458-45b9-902a-97d1775e740f tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "cinder-276eba67-dfbd-4650-93ef-514ebe513dc1-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:11 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Flow 'volume_create_manager' (abb6ca4d-8d9e-4efb-94a1-bc1f27a4023e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5187e2b4-0ccc-4676-bc09-e12416f4a463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5187e2b4-0ccc-4676-bc09-e12416f4a463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1037460792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26275c69-5179-4e38-8e1a-8d903875a873,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='69a9c60134b743c9856d1cc12e58ad43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=5be19908-f9d7-4953-927d-ece7e92ab2cd,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:12Z,use_quota=True,user_id='99b2c59b40aa4ed6925ceb4e538b7ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2821c13-dc24-4dd1-974c-a2f9eb418e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2821c13-dc24-4dd1-974c-a2f9eb418e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae2794d-53ad-4567-a055-66d27b12ac80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae2794d-53ad-4567-a055-66d27b12ac80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '26275c69-5179-4e38-8e1a-8d903875a873', 'volume_name': 'volume-26275c69-5179-4e38-8e1a-8d903875a873', 'volume_size': 1, 'source_volid': '5be19908-f9d7-4953-927d-ece7e92ab2cd', 'source_volstatus': 'available'}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea23b3b1-5e63-456b-8fb2-7de71c1d5a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea23b3b1-5e63-456b-8fb2-7de71c1d5a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a46fec11-f16e-4e83-8cd1-6169566cb172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:11 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Volume 26275c69-5179-4e38-8e1a-8d903875a873: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-26275c69-5179-4e38-8e1a-8d903875a873', 'volume_size': 1, 'source_volid': '5be19908-f9d7-4953-927d-ece7e92ab2cd', 'source_volstatus': 'available'} Apr 10 10:38:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:11 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Cloning volume 5be19908-f9d7-4953-927d-ece7e92ab2cd to volume 26275c69-5179-4e38-8e1a-8d903875a873 Apr 10 10:38:12 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Creating offline snapshot 97ec9949-71ba-4aed-ad0a-7b48959e983f of volume 5be19908-f9d7-4953-927d-ece7e92ab2cd {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:38:12 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b6eff3-a5cd-49c7-8cf6-5c66bf7afadf]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:12 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-13efb31a-bd28-405d-8aaa-ede3d6b1c6e4 tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "cinder-c0bdbfea-8ea5-4574-86f4-d325d6b25dab-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:12 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-13efb31a-bd28-405d-8aaa-ede3d6b1c6e4 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "cinder-c0bdbfea-8ea5-4574-86f4-d325d6b25dab-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:12 devstack sudo[87434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd Apr 10 10:38:12 devstack sudo[87434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:12 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-13efb31a-bd28-405d-8aaa-ede3d6b1c6e4 tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "cinder-quobyte-c0bdbfea-8ea5-4574-86f4-d325d6b25dab" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:12 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-13efb31a-bd28-405d-8aaa-ede3d6b1c6e4 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "cinder-quobyte-c0bdbfea-8ea5-4574-86f4-d325d6b25dab" acquired by "delete_volume" :: waited 0.012s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:12 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36dac0e-ecdd-43d8-bfc9-c17cd562d869]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-13efb31a-bd28-405d-8aaa-ede3d6b1c6e4 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0bdbfea-8ea5-4574-86f4-d325d6b25dab {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:12 devstack sudo[87440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0bdbfea-8ea5-4574-86f4-d325d6b25dab Apr 10 10:38:12 devstack sudo[87440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:12 devstack sudo[87432]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a48d0623-b69a-48dc-8f96-cac9b67959c5 tempest-VolumesSnapshotListTestJSON-377902434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1" returned: 0 in 0.814s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a48d0623-b69a-48dc-8f96-cac9b67959c5 tempest-VolumesSnapshotListTestJSON-377902434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:12 devstack sudo[87443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1 Apr 10 10:38:12 devstack sudo[87443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:12 devstack sudo[87434]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd" returned: 0 in 0.774s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd.97ec9949-71ba-4aed-ad0a-7b48959e983f 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:12 devstack sudo[87449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd.97ec9949-71ba-4aed-ad0a-7b48959e983f 1G Apr 10 10:38:12 devstack sudo[87449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:13 devstack sudo[87440]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-13efb31a-bd28-405d-8aaa-ede3d6b1c6e4 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0bdbfea-8ea5-4574-86f4-d325d6b25dab" returned: 0 in 0.814s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-13efb31a-bd28-405d-8aaa-ede3d6b1c6e4 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0bdbfea-8ea5-4574-86f4-d325d6b25dab {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:13 devstack sudo[87459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0bdbfea-8ea5-4574-86f4-d325d6b25dab Apr 10 10:38:13 devstack sudo[87459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:13 devstack sudo[87443]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a48d0623-b69a-48dc-8f96-cac9b67959c5 tempest-VolumesSnapshotListTestJSON-377902434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e.3f55acfb-e52e-472c-b826-8633d1212aa1" returned: 0 in 0.636s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:13 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a48d0623-b69a-48dc-8f96-cac9b67959c5 tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "cinder-quobyte-3f55acfb-e52e-472c-b826-8633d1212aa1" released by "_delete_snapshot" :: held 2.805s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:13 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a48d0623-b69a-48dc-8f96-cac9b67959c5 tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "cinder-quobyte-268815d6-e220-4379-9b72-1304ea1bf07e" released by "delete_snapshot" :: held 2.829s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:13 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-a48d0623-b69a-48dc-8f96-cac9b67959c5 tempest-VolumesSnapshotListTestJSON-377902434 None] Created reservations ['73df6c95-e8bd-4e5a-baa6-fca00ba3d830', '8e3e2090-8bac-4f25-97e2-192c2552f2a5', '26a21fa8-f5a4-4c6e-ac88-f603a91ce70c', '717d0a3a-dfb6-4241-9778-8a090d73d06b'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:13 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-a48d0623-b69a-48dc-8f96-cac9b67959c5 tempest-VolumesSnapshotListTestJSON-377902434 None] Delete snapshot completed successfully. Apr 10 10:38:13 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a48d0623-b69a-48dc-8f96-cac9b67959c5 tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "cinder-3f55acfb-e52e-472c-b826-8633d1212aa1-delete_snapshot" released by "delete_snapshot" :: held 2.947s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:13 devstack sudo[87449]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd.97ec9949-71ba-4aed-ad0a-7b48959e983f 1G" returned: 0 in 0.649s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5be19908-f9d7-4953-927d-ece7e92ab2cd -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd.97ec9949-71ba-4aed-ad0a-7b48959e983f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:13 devstack sudo[87475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5be19908-f9d7-4953-927d-ece7e92ab2cd -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd.97ec9949-71ba-4aed-ad0a-7b48959e983f Apr 10 10:38:13 devstack sudo[87475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:13 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-81e7af2c-4f17-4bdc-a783-98065bf1dd16 tempest-VolumesSnapshotListTestJSON-377902434 None] Acquiring lock "cinder-268815d6-e220-4379-9b72-1304ea1bf07e-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:13 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-81e7af2c-4f17-4bdc-a783-98065bf1dd16 tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "cinder-268815d6-e220-4379-9b72-1304ea1bf07e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:13 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-81e7af2c-4f17-4bdc-a783-98065bf1dd16 tempest-VolumesSnapshotListTestJSON-377902434 None] Acquiring lock "cinder-quobyte-268815d6-e220-4379-9b72-1304ea1bf07e" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:13 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-81e7af2c-4f17-4bdc-a783-98065bf1dd16 tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "cinder-quobyte-268815d6-e220-4379-9b72-1304ea1bf07e" acquired by "delete_volume" :: waited 0.012s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:13 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[42eab701-8a7b-441e-a123-4ef6f5403930]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-81e7af2c-4f17-4bdc-a783-98065bf1dd16 tempest-VolumesSnapshotListTestJSON-377902434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:13 devstack sudo[87459]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-13efb31a-bd28-405d-8aaa-ede3d6b1c6e4 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0bdbfea-8ea5-4574-86f4-d325d6b25dab" returned: 0 in 0.637s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:13 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-13efb31a-bd28-405d-8aaa-ede3d6b1c6e4 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "cinder-quobyte-c0bdbfea-8ea5-4574-86f4-d325d6b25dab" released by "delete_volume" :: held 1.483s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:13 devstack sudo[87478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e Apr 10 10:38:13 devstack sudo[87478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:13 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-13efb31a-bd28-405d-8aaa-ede3d6b1c6e4 tempest-CreateVolumesFromSnapshotTest-722925440 None] Created reservations ['b992690c-4ae9-455c-9460-d76b3af7f74e', '8d183da8-680b-4f73-b6a5-795a30dbbe60', '16f5cae5-5d6b-4a07-a378-54d6231c566d', '32e6c79b-ebb2-4e62-88eb-e62fe83fa1b8'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-13efb31a-bd28-405d-8aaa-ede3d6b1c6e4 tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-13efb31a-bd28-405d-8aaa-ede3d6b1c6e4 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:13 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-13efb31a-bd28-405d-8aaa-ede3d6b1c6e4 tempest-CreateVolumesFromSnapshotTest-722925440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:13 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-13efb31a-bd28-405d-8aaa-ede3d6b1c6e4 tempest-CreateVolumesFromSnapshotTest-722925440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-13efb31a-bd28-405d-8aaa-ede3d6b1c6e4 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-13efb31a-bd28-405d-8aaa-ede3d6b1c6e4 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:13 devstack sudo[87480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:38:13 devstack sudo[87480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:14 devstack sudo[87475]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5be19908-f9d7-4953-927d-ece7e92ab2cd -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd.97ec9949-71ba-4aed-ad0a-7b48959e983f" returned: 0 in 0.641s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:14 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd.97ec9949-71ba-4aed-ad0a-7b48959e983f is being set with open permissions: ugo+rw Apr 10 10:38:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd.97ec9949-71ba-4aed-ad0a-7b48959e983f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:14 devstack sudo[87488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd.97ec9949-71ba-4aed-ad0a-7b48959e983f Apr 10 10:38:14 devstack sudo[87488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:14 devstack sudo[87478]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-81e7af2c-4f17-4bdc-a783-98065bf1dd16 tempest-VolumesSnapshotListTestJSON-377902434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e" returned: 0 in 0.593s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-81e7af2c-4f17-4bdc-a783-98065bf1dd16 tempest-VolumesSnapshotListTestJSON-377902434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:14 devstack sudo[87491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e Apr 10 10:38:14 devstack sudo[87480]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:14 devstack sudo[87491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-13efb31a-bd28-405d-8aaa-ede3d6b1c6e4 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.464s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:14 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-13efb31a-bd28-405d-8aaa-ede3d6b1c6e4 tempest-CreateVolumesFromSnapshotTest-722925440 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:14 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-13efb31a-bd28-405d-8aaa-ede3d6b1c6e4 tempest-CreateVolumesFromSnapshotTest-722925440 None] Deleted volume successfully. Apr 10 10:38:14 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-13efb31a-bd28-405d-8aaa-ede3d6b1c6e4 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "cinder-c0bdbfea-8ea5-4574-86f4-d325d6b25dab-delete_volume" released by "delete_volume" :: held 2.131s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:14 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e40f2e7e-7a5d-480e-a365-14f6ce8e7890 tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "cinder-dc5d42f1-2277-4a9e-9652-2081a87f1dae-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:14 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e40f2e7e-7a5d-480e-a365-14f6ce8e7890 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "cinder-dc5d42f1-2277-4a9e-9652-2081a87f1dae-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:14 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e40f2e7e-7a5d-480e-a365-14f6ce8e7890 tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "cinder-quobyte-dc5d42f1-2277-4a9e-9652-2081a87f1dae" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:14 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e40f2e7e-7a5d-480e-a365-14f6ce8e7890 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "cinder-quobyte-dc5d42f1-2277-4a9e-9652-2081a87f1dae" acquired by "delete_volume" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:14 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc8d052-6124-4aee-87f7-563878340cad]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e40f2e7e-7a5d-480e-a365-14f6ce8e7890 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dc5d42f1-2277-4a9e-9652-2081a87f1dae {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:14 devstack sudo[87493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dc5d42f1-2277-4a9e-9652-2081a87f1dae Apr 10 10:38:14 devstack sudo[87493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:14 devstack sudo[87488]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd.97ec9949-71ba-4aed-ad0a-7b48959e983f" returned: 0 in 0.509s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:14 devstack sudo[87497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd.info Apr 10 10:38:14 devstack sudo[87497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:14 devstack sudo[87491]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-81e7af2c-4f17-4bdc-a783-98065bf1dd16 tempest-VolumesSnapshotListTestJSON-377902434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-268815d6-e220-4379-9b72-1304ea1bf07e" returned: 0 in 0.484s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:14 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-81e7af2c-4f17-4bdc-a783-98065bf1dd16 tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "cinder-quobyte-268815d6-e220-4379-9b72-1304ea1bf07e" released by "delete_volume" :: held 1.122s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:14 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-81e7af2c-4f17-4bdc-a783-98065bf1dd16 tempest-VolumesSnapshotListTestJSON-377902434 None] Created reservations ['47db716c-2e7f-41ab-b999-e0ebe357d828', '8c99fc38-506f-4994-8179-7112d8f11565', '3ddb5abb-7454-467f-a07b-ad66407ce515', 'd6e67db7-479e-4408-8592-274a4821a9f4'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-81e7af2c-4f17-4bdc-a783-98065bf1dd16 tempest-VolumesSnapshotListTestJSON-377902434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-81e7af2c-4f17-4bdc-a783-98065bf1dd16 tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:14 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-81e7af2c-4f17-4bdc-a783-98065bf1dd16 tempest-VolumesSnapshotListTestJSON-377902434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:14 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-81e7af2c-4f17-4bdc-a783-98065bf1dd16 tempest-VolumesSnapshotListTestJSON-377902434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-81e7af2c-4f17-4bdc-a783-98065bf1dd16 tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-81e7af2c-4f17-4bdc-a783-98065bf1dd16 tempest-VolumesSnapshotListTestJSON-377902434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:14 devstack sudo[87501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:38:14 devstack sudo[87501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:15 devstack sudo[87493]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e40f2e7e-7a5d-480e-a365-14f6ce8e7890 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dc5d42f1-2277-4a9e-9652-2081a87f1dae" returned: 0 in 0.652s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e40f2e7e-7a5d-480e-a365-14f6ce8e7890 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dc5d42f1-2277-4a9e-9652-2081a87f1dae {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:15 devstack sudo[87505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dc5d42f1-2277-4a9e-9652-2081a87f1dae Apr 10 10:38:15 devstack sudo[87505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:15 devstack sudo[87497]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd.info" returned: 0 in 0.531s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:15 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd.info is being set with open permissions: ugo+rw Apr 10 10:38:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:15 devstack sudo[87507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd.info Apr 10 10:38:15 devstack sudo[87507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:15 devstack sudo[87501]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-81e7af2c-4f17-4bdc-a783-98065bf1dd16 tempest-VolumesSnapshotListTestJSON-377902434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.552s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:15 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-81e7af2c-4f17-4bdc-a783-98065bf1dd16 tempest-VolumesSnapshotListTestJSON-377902434 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:15 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-81e7af2c-4f17-4bdc-a783-98065bf1dd16 tempest-VolumesSnapshotListTestJSON-377902434 None] Deleted volume successfully. Apr 10 10:38:15 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-81e7af2c-4f17-4bdc-a783-98065bf1dd16 tempest-VolumesSnapshotListTestJSON-377902434 None] Lock "cinder-268815d6-e220-4379-9b72-1304ea1bf07e-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:15 devstack sudo[87505]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e40f2e7e-7a5d-480e-a365-14f6ce8e7890 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dc5d42f1-2277-4a9e-9652-2081a87f1dae" returned: 0 in 0.488s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:15 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e40f2e7e-7a5d-480e-a365-14f6ce8e7890 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "cinder-quobyte-dc5d42f1-2277-4a9e-9652-2081a87f1dae" released by "delete_volume" :: held 1.162s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:15 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-e40f2e7e-7a5d-480e-a365-14f6ce8e7890 tempest-CreateVolumesFromSnapshotTest-722925440 None] Created reservations ['c88b8c19-2e34-45d0-8ca4-b47341e7e830', '047527f9-b71f-4d4a-8fdc-3c67a2d15dc5', '4eb20533-a8f0-41b6-815e-3e6dd7ecc1a9', '69a6c096-b730-4165-a8ee-7b898e225e66'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e40f2e7e-7a5d-480e-a365-14f6ce8e7890 tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e40f2e7e-7a5d-480e-a365-14f6ce8e7890 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:15 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e40f2e7e-7a5d-480e-a365-14f6ce8e7890 tempest-CreateVolumesFromSnapshotTest-722925440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:15 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e40f2e7e-7a5d-480e-a365-14f6ce8e7890 tempest-CreateVolumesFromSnapshotTest-722925440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e40f2e7e-7a5d-480e-a365-14f6ce8e7890 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e40f2e7e-7a5d-480e-a365-14f6ce8e7890 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:15 devstack sudo[87512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:38:15 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:15 devstack sudo[87507]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd.info" returned: 0 in 0.540s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:15 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Acquiring lock "cinder-quobyte-26275c69-5179-4e38-8e1a-8d903875a873" by "_copy_volume_from_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:15 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Lock "cinder-quobyte-26275c69-5179-4e38-8e1a-8d903875a873" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:15 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] snapshot: 97ec9949-71ba-4aed-ad0a-7b48959e983f, volume: 26275c69-5179-4e38-8e1a-8d903875a873, {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:38:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:15 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:15 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:15 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e9802e-5e8a-49af-8a55-90ffa91227dc]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd.97ec9949-71ba-4aed-ad0a-7b48959e983f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:15 devstack sudo[87514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd.97ec9949-71ba-4aed-ad0a-7b48959e983f Apr 10 10:38:15 devstack sudo[87514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:16 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e40f2e7e-7a5d-480e-a365-14f6ce8e7890 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.542s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:16 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-e40f2e7e-7a5d-480e-a365-14f6ce8e7890 tempest-CreateVolumesFromSnapshotTest-722925440 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:16 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-e40f2e7e-7a5d-480e-a365-14f6ce8e7890 tempest-CreateVolumesFromSnapshotTest-722925440 None] Deleted volume successfully. Apr 10 10:38:16 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e40f2e7e-7a5d-480e-a365-14f6ce8e7890 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "cinder-dc5d42f1-2277-4a9e-9652-2081a87f1dae-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:16 devstack sudo[87514]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd.97ec9949-71ba-4aed-ad0a-7b48959e983f" returned: 0 in 0.698s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:16 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5be19908-f9d7-4953-927d-ece7e92ab2cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:16 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:38:16 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Creating direct copy from snapshot {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:38:16 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[2212cb59-d11f-4a38-a275-1160e4c83ad1]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:16 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-5681c677-9411-41b7-b533-fb795d702f30 tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "cinder-c425852d-89d5-4b04-9b09-503ff05f00a1-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:16 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-5681c677-9411-41b7-b533-fb795d702f30 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "cinder-c425852d-89d5-4b04-9b09-503ff05f00a1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:16 devstack sudo[87523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd Apr 10 10:38:16 devstack sudo[87523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:16 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-5681c677-9411-41b7-b533-fb795d702f30 tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "cinder-quobyte-c425852d-89d5-4b04-9b09-503ff05f00a1" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:16 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-5681c677-9411-41b7-b533-fb795d702f30 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "cinder-quobyte-c425852d-89d5-4b04-9b09-503ff05f00a1" acquired by "delete_volume" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:16 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33b3c5e-420c-4024-9684-7c09d0fe083d]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5681c677-9411-41b7-b533-fb795d702f30 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c425852d-89d5-4b04-9b09-503ff05f00a1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:16 devstack sudo[87525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c425852d-89d5-4b04-9b09-503ff05f00a1 Apr 10 10:38:16 devstack sudo[87525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:17 devstack sudo[87523]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd" returned: 0 in 0.637s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:17 devstack cinder-volume[81938]: DEBUG cinder.utils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Path /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-26275c69-5179-4e38-8e1a-8d903875a873 not found in is_blk_device check {{(pid=81938) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:38:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-26275c69-5179-4e38-8e1a-8d903875a873 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:17 devstack sudo[87532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-26275c69-5179-4e38-8e1a-8d903875a873 Apr 10 10:38:17 devstack sudo[87532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:17 devstack sudo[87525]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5681c677-9411-41b7-b533-fb795d702f30 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c425852d-89d5-4b04-9b09-503ff05f00a1" returned: 0 in 0.643s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5681c677-9411-41b7-b533-fb795d702f30 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c425852d-89d5-4b04-9b09-503ff05f00a1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:17 devstack sudo[87535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c425852d-89d5-4b04-9b09-503ff05f00a1 Apr 10 10:38:17 devstack sudo[87535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:17 devstack sudo[87535]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5681c677-9411-41b7-b533-fb795d702f30 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c425852d-89d5-4b04-9b09-503ff05f00a1" returned: 0 in 0.647s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:17 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-5681c677-9411-41b7-b533-fb795d702f30 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "cinder-quobyte-c425852d-89d5-4b04-9b09-503ff05f00a1" released by "delete_volume" :: held 1.331s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:18 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writing DB stats cinder:SELECT=166,cinder:INSERT=57,cinder:UPDATE=197,cinder:DELETE=23 {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:38:18 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-5681c677-9411-41b7-b533-fb795d702f30 tempest-CreateVolumesFromSnapshotTest-722925440 None] Created reservations ['883d3e8d-235c-4a82-9d79-ce0944adb9f0', '0de19096-89b9-43ac-bb24-2e821e7b08a3', '7664cb79-5c3d-4c77-a3ff-823c9b5583f3', '683ca49d-684e-4209-899a-dd300213389d'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:18 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writing DB stats cinder:UPDATE=230,cinder:SELECT=160,cinder:INSERT=51,cinder:DELETE=16 {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:38:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5681c677-9411-41b7-b533-fb795d702f30 tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5681c677-9411-41b7-b533-fb795d702f30 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:18 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5681c677-9411-41b7-b533-fb795d702f30 tempest-CreateVolumesFromSnapshotTest-722925440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:18 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5681c677-9411-41b7-b533-fb795d702f30 tempest-CreateVolumesFromSnapshotTest-722925440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5681c677-9411-41b7-b533-fb795d702f30 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5681c677-9411-41b7-b533-fb795d702f30 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:18 devstack sudo[87572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:38:18 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:18 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-dd9e088f-b2cf-4d45-af33-552a6d35bf38 tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "cinder-93855a4c-1749-4df3-97f2-5b2119f54d6f-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:18 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-dd9e088f-b2cf-4d45-af33-552a6d35bf38 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "cinder-93855a4c-1749-4df3-97f2-5b2119f54d6f-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:19 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-dd9e088f-b2cf-4d45-af33-552a6d35bf38 tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "cinder-quobyte-93855a4c-1749-4df3-97f2-5b2119f54d6f" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:19 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-dd9e088f-b2cf-4d45-af33-552a6d35bf38 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "cinder-quobyte-93855a4c-1749-4df3-97f2-5b2119f54d6f" acquired by "delete_volume" :: waited 0.038s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:19 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[47783e70-9044-4c4d-a198-709d5e11c7b8]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dd9e088f-b2cf-4d45-af33-552a6d35bf38 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-93855a4c-1749-4df3-97f2-5b2119f54d6f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:19 devstack sudo[87575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-93855a4c-1749-4df3-97f2-5b2119f54d6f Apr 10 10:38:19 devstack sudo[87575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:20 devstack sudo[87532]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-26275c69-5179-4e38-8e1a-8d903875a873" returned: 0 in 3.319s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:20 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a8baf0-13ed-4c1e-950c-879429e4b78e]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:20 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5681c677-9411-41b7-b533-fb795d702f30 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 1.993s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:20 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-5681c677-9411-41b7-b533-fb795d702f30 tempest-CreateVolumesFromSnapshotTest-722925440 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:20 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-5681c677-9411-41b7-b533-fb795d702f30 tempest-CreateVolumesFromSnapshotTest-722925440 None] Deleted volume successfully. Apr 10 10:38:20 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-5681c677-9411-41b7-b533-fb795d702f30 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "cinder-c425852d-89d5-4b04-9b09-503ff05f00a1-delete_volume" released by "delete_volume" :: held 4.031s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:20 devstack sudo[87580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd Apr 10 10:38:20 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:20 devstack sudo[87575]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dd9e088f-b2cf-4d45-af33-552a6d35bf38 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-93855a4c-1749-4df3-97f2-5b2119f54d6f" returned: 0 in 1.377s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dd9e088f-b2cf-4d45-af33-552a6d35bf38 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-93855a4c-1749-4df3-97f2-5b2119f54d6f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:20 devstack sudo[87585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-93855a4c-1749-4df3-97f2-5b2119f54d6f Apr 10 10:38:20 devstack sudo[87585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:21 devstack sudo[87585]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dd9e088f-b2cf-4d45-af33-552a6d35bf38 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-93855a4c-1749-4df3-97f2-5b2119f54d6f" returned: 0 in 0.551s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-dd9e088f-b2cf-4d45-af33-552a6d35bf38 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "cinder-quobyte-93855a4c-1749-4df3-97f2-5b2119f54d6f" released by "delete_volume" :: held 1.998s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:21 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd" returned: 0 in 0.777s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:21 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd, size 1024.00 MB, duration 3.32 sec, destination /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-26275c69-5179-4e38-8e1a-8d903875a873 {{(pid=81938) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:38:21 devstack cinder-volume[81938]: INFO cinder.image.image_utils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Converted 1024.00 MB image at 308.38 MB/s Apr 10 10:38:21 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-26275c69-5179-4e38-8e1a-8d903875a873 is being set with open permissions: ugo+rw Apr 10 10:38:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-26275c69-5179-4e38-8e1a-8d903875a873 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:21 devstack sudo[87591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-26275c69-5179-4e38-8e1a-8d903875a873 Apr 10 10:38:21 devstack sudo[87591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:21 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-dd9e088f-b2cf-4d45-af33-552a6d35bf38 tempest-CreateVolumesFromSnapshotTest-722925440 None] Created reservations ['6fcf1009-5794-4a5c-9e80-8364eb719256', '95b68976-4eb1-4df0-b847-7ac821976036', '99b98d5d-30c2-4129-944d-b75a1aeb4b22', '8d1daaf1-45ec-4fb1-803c-1493d8daaefa'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-dd9e088f-b2cf-4d45-af33-552a6d35bf38 tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-dd9e088f-b2cf-4d45-af33-552a6d35bf38 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:21 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-dd9e088f-b2cf-4d45-af33-552a6d35bf38 tempest-CreateVolumesFromSnapshotTest-722925440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:21 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-dd9e088f-b2cf-4d45-af33-552a6d35bf38 tempest-CreateVolumesFromSnapshotTest-722925440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-dd9e088f-b2cf-4d45-af33-552a6d35bf38 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dd9e088f-b2cf-4d45-af33-552a6d35bf38 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:21 devstack sudo[87593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:38:21 devstack sudo[87593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-eaed0636-e3dd-417e-8fec-c2a5c89c502b tempest-VolumesActionsTest-583784559 None] Acquiring lock "cinder-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f" by "attach_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-eaed0636-e3dd-417e-8fec-c2a5c89c502b tempest-VolumesActionsTest-583784559 None] Lock "cinder-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f" acquired by "attach_volume" :: waited 0.011s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:21 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-eaed0636-e3dd-417e-8fec-c2a5c89c502b tempest-VolumesActionsTest-583784559 None] Attaching volume b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f to instance df2b536a-e5b2-4787-aab9-56f635ad97de at mountpoint /dev/vdb on host None. Apr 10 10:38:21 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-eaed0636-e3dd-417e-8fec-c2a5c89c502b tempest-VolumesActionsTest-583784559 None] Attach volume completed successfully. Apr 10 10:38:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-eaed0636-e3dd-417e-8fec-c2a5c89c502b tempest-VolumesActionsTest-583784559 None] Lock "cinder-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f" released by "attach_volume" :: held 0.073s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:21 devstack sudo[87591]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-26275c69-5179-4e38-8e1a-8d903875a873" returned: 0 in 0.499s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Lock "cinder-quobyte-26275c69-5179-4e38-8e1a-8d903875a873" released by "_copy_volume_from_snapshot" :: held 5.996s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Acquiring lock "cinder-quobyte-97ec9949-71ba-4aed-ad0a-7b48959e983f" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Lock "cinder-quobyte-97ec9949-71ba-4aed-ad0a-7b48959e983f" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:21 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Deleting offline snapshot 97ec9949-71ba-4aed-ad0a-7b48959e983f of volume 5be19908-f9d7-4953-927d-ece7e92ab2cd {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:38:21 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] snapshot_file for this snap is: volume-5be19908-f9d7-4953-927d-ece7e92ab2cd.97ec9949-71ba-4aed-ad0a-7b48959e983f {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:38:21 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e30d3a-0a6f-450c-adbf-68f4f6091a6b]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd.97ec9949-71ba-4aed-ad0a-7b48959e983f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:21 devstack sudo[87593]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dd9e088f-b2cf-4d45-af33-552a6d35bf38 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.486s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:21 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-dd9e088f-b2cf-4d45-af33-552a6d35bf38 tempest-CreateVolumesFromSnapshotTest-722925440 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:21 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-dd9e088f-b2cf-4d45-af33-552a6d35bf38 tempest-CreateVolumesFromSnapshotTest-722925440 None] Deleted volume successfully. Apr 10 10:38:21 devstack sudo[87597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd.97ec9949-71ba-4aed-ad0a-7b48959e983f Apr 10 10:38:21 devstack sudo[87597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-dd9e088f-b2cf-4d45-af33-552a6d35bf38 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "cinder-93855a4c-1749-4df3-97f2-5b2119f54d6f-delete_volume" released by "delete_volume" :: held 2.909s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:22 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-fe22a18c-8f2f-46e6-ba74-2cf38b04f89a tempest-VolumesActionsTest-583784559 None] Acquiring lock "cinder-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f-detach_volume" by "detach_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:22 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-fe22a18c-8f2f-46e6-ba74-2cf38b04f89a tempest-VolumesActionsTest-583784559 None] Lock "cinder-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:22 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-fe22a18c-8f2f-46e6-ba74-2cf38b04f89a tempest-VolumesActionsTest-583784559 None] Detaching volume b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f from instance df2b536a-e5b2-4787-aab9-56f635ad97de. Apr 10 10:38:22 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-fe22a18c-8f2f-46e6-ba74-2cf38b04f89a tempest-VolumesActionsTest-583784559 None] Detach volume completed successfully. Apr 10 10:38:22 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-fe22a18c-8f2f-46e6-ba74-2cf38b04f89a tempest-VolumesActionsTest-583784559 None] Lock "cinder-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f-detach_volume" released by "detach_volume" :: held 0.045s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:22 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f0ca0065-35c9-4ef4-b70f-2ffc69d26302 tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "cinder-7bbecb8d-8ecc-4cee-923e-109c8686de22-delete_snapshot" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:22 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f0ca0065-35c9-4ef4-b70f-2ffc69d26302 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "cinder-7bbecb8d-8ecc-4cee-923e-109c8686de22-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:22 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f0ca0065-35c9-4ef4-b70f-2ffc69d26302 tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "cinder-quobyte-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:22 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f0ca0065-35c9-4ef4-b70f-2ffc69d26302 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "cinder-quobyte-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:22 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f0ca0065-35c9-4ef4-b70f-2ffc69d26302 tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "cinder-quobyte-7bbecb8d-8ecc-4cee-923e-109c8686de22" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:22 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f0ca0065-35c9-4ef4-b70f-2ffc69d26302 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "cinder-quobyte-7bbecb8d-8ecc-4cee-923e-109c8686de22" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-f0ca0065-35c9-4ef4-b70f-2ffc69d26302 tempest-CreateVolumesFromSnapshotTest-722925440 None] Deleting offline snapshot 7bbecb8d-8ecc-4cee-923e-109c8686de22 of volume c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:38:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-f0ca0065-35c9-4ef4-b70f-2ffc69d26302 tempest-CreateVolumesFromSnapshotTest-722925440 None] snapshot_file for this snap is: volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac.7bbecb8d-8ecc-4cee-923e-109c8686de22 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:38:22 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed59803-2eb7-45b7-bf12-2f0dedaacad0]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f0ca0065-35c9-4ef4-b70f-2ffc69d26302 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac.7bbecb8d-8ecc-4cee-923e-109c8686de22 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:22 devstack sudo[87597]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd.97ec9949-71ba-4aed-ad0a-7b48959e983f" returned: 0 in 0.625s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5be19908-f9d7-4953-927d-ece7e92ab2cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:22 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd4eac8-376a-46dd-ac6f-12d3f77854b8]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:22 devstack sudo[87602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac.7bbecb8d-8ecc-4cee-923e-109c8686de22 Apr 10 10:38:22 devstack sudo[87602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:22 devstack sudo[87603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd Apr 10 10:38:22 devstack sudo[87603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:22 devstack sudo[87602]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f0ca0065-35c9-4ef4-b70f-2ffc69d26302 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac.7bbecb8d-8ecc-4cee-923e-109c8686de22" returned: 0 in 0.550s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-f0ca0065-35c9-4ef4-b70f-2ffc69d26302 tempest-CreateVolumesFromSnapshotTest-722925440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:22 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bed776-b527-4e5f-b304-e19257d0d29f]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f0ca0065-35c9-4ef4-b70f-2ffc69d26302 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:23 devstack sudo[87612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac Apr 10 10:38:23 devstack sudo[87612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:23 devstack sudo[87603]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd" returned: 0 in 0.628s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd.97ec9949-71ba-4aed-ad0a-7b48959e983f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:23 devstack sudo[87614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd.97ec9949-71ba-4aed-ad0a-7b48959e983f Apr 10 10:38:23 devstack sudo[87614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:23 devstack sudo[87612]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f0ca0065-35c9-4ef4-b70f-2ffc69d26302 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac" returned: 0 in 0.524s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f0ca0065-35c9-4ef4-b70f-2ffc69d26302 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac.7bbecb8d-8ecc-4cee-923e-109c8686de22 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:23 devstack sudo[87622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac.7bbecb8d-8ecc-4cee-923e-109c8686de22 Apr 10 10:38:23 devstack sudo[87622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:23 devstack sudo[87614]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd.97ec9949-71ba-4aed-ad0a-7b48959e983f" returned: 0 in 0.492s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd.97ec9949-71ba-4aed-ad0a-7b48959e983f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:23 devstack sudo[87624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd.97ec9949-71ba-4aed-ad0a-7b48959e983f Apr 10 10:38:23 devstack sudo[87624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:24 devstack sudo[87624]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd.97ec9949-71ba-4aed-ad0a-7b48959e983f" returned: 0 in 0.584s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:24 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Lock "cinder-quobyte-97ec9949-71ba-4aed-ad0a-7b48959e983f" released by "_delete_snapshot" :: held 2.379s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.179s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:24 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a46fec11-f16e-4e83-8cd1-6169566cb172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26275c69-5179-4e38-8e1a-8d903875a873', 'volume_size': 1, 'source_volid': '5be19908-f9d7-4953-927d-ece7e92ab2cd', 'source_volstatus': 'available'}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:24 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b4ca95e-2105-48ca-b933-067cc825d711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:24 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Volume volume-26275c69-5179-4e38-8e1a-8d903875a873 (26275c69-5179-4e38-8e1a-8d903875a873): created successfully Apr 10 10:38:24 devstack sudo[87622]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:24 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b4ca95e-2105-48ca-b933-067cc825d711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:24 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Flow 'volume_create_manager' (abb6ca4d-8d9e-4efb-94a1-bc1f27a4023e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f0ca0065-35c9-4ef4-b70f-2ffc69d26302 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac.7bbecb8d-8ecc-4cee-923e-109c8686de22" returned: 0 in 0.727s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f0ca0065-35c9-4ef4-b70f-2ffc69d26302 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac.7bbecb8d-8ecc-4cee-923e-109c8686de22 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:24 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-3a37bbea-7ebb-4cc0-a7e2-e36a5446a29f tempest-VolumesGetTest-1117816825 None] Created volume successfully. Apr 10 10:38:24 devstack sudo[87651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac.7bbecb8d-8ecc-4cee-923e-109c8686de22 Apr 10 10:38:24 devstack sudo[87651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:24 devstack sudo[87651]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f0ca0065-35c9-4ef4-b70f-2ffc69d26302 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac.7bbecb8d-8ecc-4cee-923e-109c8686de22" returned: 0 in 0.509s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:24 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f0ca0065-35c9-4ef4-b70f-2ffc69d26302 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "cinder-quobyte-7bbecb8d-8ecc-4cee-923e-109c8686de22" released by "_delete_snapshot" :: held 2.383s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:24 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f0ca0065-35c9-4ef4-b70f-2ffc69d26302 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "cinder-quobyte-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac" released by "delete_snapshot" :: held 2.399s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:24 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-f0ca0065-35c9-4ef4-b70f-2ffc69d26302 tempest-CreateVolumesFromSnapshotTest-722925440 None] Created reservations ['b19bbd7f-f40a-4a6f-9705-a42e2427378e', '92efae9f-0322-4fac-a27c-18d8d6ca8dbe', '47390c19-5ab3-4720-95e3-98d7024f1daf', '2c6e644c-6312-4f12-95ec-f7bf713cbc4f'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:24 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-f0ca0065-35c9-4ef4-b70f-2ffc69d26302 tempest-CreateVolumesFromSnapshotTest-722925440 None] Delete snapshot completed successfully. Apr 10 10:38:24 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f0ca0065-35c9-4ef4-b70f-2ffc69d26302 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "cinder-7bbecb8d-8ecc-4cee-923e-109c8686de22-delete_snapshot" released by "delete_snapshot" :: held 2.495s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-859132a9-428a-4153-9594-c4f4a25eb563 tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "cinder-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-859132a9-428a-4153-9594-c4f4a25eb563 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "cinder-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-859132a9-428a-4153-9594-c4f4a25eb563 tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "cinder-quobyte-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-859132a9-428a-4153-9594-c4f4a25eb563 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "cinder-quobyte-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:25 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[41689806-77ed-4de5-bf11-615a04c7ed2f]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-859132a9-428a-4153-9594-c4f4a25eb563 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:25 devstack sudo[87659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac Apr 10 10:38:25 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:25 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] Flow 'volume_create_manager' (f10bbf4f-7cc3-4468-acc1-60e6fd716ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3943305-2c0e-4cfb-829b-16e46507e564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3943305-2c0e-4cfb-829b-16e46507e564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1255030529',display_name='tempest-VolumesGetTest-Volume-1531344754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4d4a9ce-9e1d-47f6-992b-92c5a420417f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69a9c60134b743c9856d1cc12e58ad43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:26Z,use_quota=True,user_id='99b2c59b40aa4ed6925ceb4e538b7ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67dd200d-4383-4f94-b573-07859a447a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67dd200d-4383-4f94-b573-07859a447a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c0b1295-25ff-4d80-b0dc-477ec4947122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c0b1295-25ff-4d80-b0dc-477ec4947122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4d4a9ce-9e1d-47f6-992b-92c5a420417f', 'volume_name': 'volume-e4d4a9ce-9e1d-47f6-992b-92c5a420417f', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46111e3d-81bd-4d1e-9ee5-7e4059a3e69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46111e3d-81bd-4d1e-9ee5-7e4059a3e69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e5b082-792e-4b1b-a73c-70fe4d48d5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:25 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] Volume e4d4a9ce-9e1d-47f6-992b-92c5a420417f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4d4a9ce-9e1d-47f6-992b-92c5a420417f', 'volume_size': 1} Apr 10 10:38:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1255030529',display_name='tempest-VolumesGetTest-Volume-1531344754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4d4a9ce-9e1d-47f6-992b-92c5a420417f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69a9c60134b743c9856d1cc12e58ad43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:26Z,use_quota=True,user_id='99b2c59b40aa4ed6925ceb4e538b7ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] Creating volume e4d4a9ce-9e1d-47f6-992b-92c5a420417f {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:25 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:38:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e4d4a9ce-9e1d-47f6-992b-92c5a420417f 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:25 devstack sudo[87662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e4d4a9ce-9e1d-47f6-992b-92c5a420417f 1073741824 Apr 10 10:38:25 devstack sudo[87662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:26 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-859132a9-428a-4153-9594-c4f4a25eb563 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac" returned: 0 in 0.638s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-859132a9-428a-4153-9594-c4f4a25eb563 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:26 devstack sudo[87670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac Apr 10 10:38:26 devstack sudo[87670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:26 devstack sudo[87662]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e4d4a9ce-9e1d-47f6-992b-92c5a420417f 1073741824" returned: 0 in 0.572s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e4d4a9ce-9e1d-47f6-992b-92c5a420417f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:26 devstack sudo[87672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e4d4a9ce-9e1d-47f6-992b-92c5a420417f Apr 10 10:38:26 devstack sudo[87672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:26 devstack sudo[87670]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-859132a9-428a-4153-9594-c4f4a25eb563 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac" returned: 0 in 0.619s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:26 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-859132a9-428a-4153-9594-c4f4a25eb563 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "cinder-quobyte-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac" released by "delete_volume" :: held 1.303s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:26 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-859132a9-428a-4153-9594-c4f4a25eb563 tempest-CreateVolumesFromSnapshotTest-722925440 None] Created reservations ['f6cf5621-b7c8-4b1e-8e87-a1ba11c69cf5', '4f344d28-d8e6-4491-9af2-2b0111614350', '997c86e9-0095-4c63-b34c-c0147a70d853', 'd4ab469a-bd38-46b7-9729-1c3682af6f03'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-859132a9-428a-4153-9594-c4f4a25eb563 tempest-CreateVolumesFromSnapshotTest-722925440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-859132a9-428a-4153-9594-c4f4a25eb563 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:26 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-859132a9-428a-4153-9594-c4f4a25eb563 tempest-CreateVolumesFromSnapshotTest-722925440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:26 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-859132a9-428a-4153-9594-c4f4a25eb563 tempest-CreateVolumesFromSnapshotTest-722925440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-859132a9-428a-4153-9594-c4f4a25eb563 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-859132a9-428a-4153-9594-c4f4a25eb563 tempest-CreateVolumesFromSnapshotTest-722925440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:26 devstack sudo[87676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:38:26 devstack sudo[87676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:27 devstack sudo[87672]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e4d4a9ce-9e1d-47f6-992b-92c5a420417f" returned: 0 in 0.567s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:27 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e5b082-792e-4b1b-a73c-70fe4d48d5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4d4a9ce-9e1d-47f6-992b-92c5a420417f', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61676335-d1e1-4daf-b009-6ec35ab3ae36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:27 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] Volume volume-e4d4a9ce-9e1d-47f6-992b-92c5a420417f (e4d4a9ce-9e1d-47f6-992b-92c5a420417f): created successfully Apr 10 10:38:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61676335-d1e1-4daf-b009-6ec35ab3ae36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] Flow 'volume_create_manager' (f10bbf4f-7cc3-4468-acc1-60e6fd716ce0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:27 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-6c793629-0cb0-4b49-bb53-253b86b9fd5f tempest-VolumesGetTest-1117816825 None] Created volume successfully. Apr 10 10:38:27 devstack sudo[87676]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-859132a9-428a-4153-9594-c4f4a25eb563 tempest-CreateVolumesFromSnapshotTest-722925440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.468s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:27 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-859132a9-428a-4153-9594-c4f4a25eb563 tempest-CreateVolumesFromSnapshotTest-722925440 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:27 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-859132a9-428a-4153-9594-c4f4a25eb563 tempest-CreateVolumesFromSnapshotTest-722925440 None] Deleted volume successfully. Apr 10 10:38:27 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-859132a9-428a-4153-9594-c4f4a25eb563 tempest-CreateVolumesFromSnapshotTest-722925440 None] Lock "cinder-c0840dc1-3a3b-4d42-a2f7-2d6220ce14ac-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:28 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-27332509-0b8b-4557-ab4d-c9a542b2423e tempest-VolumesGetTest-1117816825 None] Acquiring lock "cinder-e4d4a9ce-9e1d-47f6-992b-92c5a420417f-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:28 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-27332509-0b8b-4557-ab4d-c9a542b2423e tempest-VolumesGetTest-1117816825 None] Lock "cinder-e4d4a9ce-9e1d-47f6-992b-92c5a420417f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:28 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-27332509-0b8b-4557-ab4d-c9a542b2423e tempest-VolumesGetTest-1117816825 None] Acquiring lock "cinder-quobyte-e4d4a9ce-9e1d-47f6-992b-92c5a420417f" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:28 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-27332509-0b8b-4557-ab4d-c9a542b2423e tempest-VolumesGetTest-1117816825 None] Lock "cinder-quobyte-e4d4a9ce-9e1d-47f6-992b-92c5a420417f" acquired by "delete_volume" :: waited 0.011s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:28 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb5f8cb-d67e-4a05-9c2b-21f680a2ef0c]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-27332509-0b8b-4557-ab4d-c9a542b2423e tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e4d4a9ce-9e1d-47f6-992b-92c5a420417f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:28 devstack sudo[87679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e4d4a9ce-9e1d-47f6-992b-92c5a420417f Apr 10 10:38:28 devstack sudo[87679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:28 devstack sudo[87679]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-27332509-0b8b-4557-ab4d-c9a542b2423e tempest-VolumesGetTest-1117816825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e4d4a9ce-9e1d-47f6-992b-92c5a420417f" returned: 0 in 0.617s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-27332509-0b8b-4557-ab4d-c9a542b2423e tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e4d4a9ce-9e1d-47f6-992b-92c5a420417f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:28 devstack sudo[87684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e4d4a9ce-9e1d-47f6-992b-92c5a420417f Apr 10 10:38:28 devstack sudo[87684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:29 devstack sudo[87684]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-27332509-0b8b-4557-ab4d-c9a542b2423e tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e4d4a9ce-9e1d-47f6-992b-92c5a420417f" returned: 0 in 0.634s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:29 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-27332509-0b8b-4557-ab4d-c9a542b2423e tempest-VolumesGetTest-1117816825 None] Lock "cinder-quobyte-e4d4a9ce-9e1d-47f6-992b-92c5a420417f" released by "delete_volume" :: held 1.284s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:29 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-27332509-0b8b-4557-ab4d-c9a542b2423e tempest-VolumesGetTest-1117816825 None] Created reservations ['c3c7d43d-fd74-4e58-9d2a-df93bd61005f', 'e05f8657-ef01-4fc3-8e42-75e1fb013f72', '10072095-498b-42af-91ef-35bb743a8689', '38d75ad9-60fb-4c51-a627-e156b847606b'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-27332509-0b8b-4557-ab4d-c9a542b2423e tempest-VolumesGetTest-1117816825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-27332509-0b8b-4557-ab4d-c9a542b2423e tempest-VolumesGetTest-1117816825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:29 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-27332509-0b8b-4557-ab4d-c9a542b2423e tempest-VolumesGetTest-1117816825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:29 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-27332509-0b8b-4557-ab4d-c9a542b2423e tempest-VolumesGetTest-1117816825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-27332509-0b8b-4557-ab4d-c9a542b2423e tempest-VolumesGetTest-1117816825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-27332509-0b8b-4557-ab4d-c9a542b2423e tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:29 devstack sudo[87687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:38:29 devstack sudo[87687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:29 devstack sudo[87687]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-27332509-0b8b-4557-ab4d-c9a542b2423e tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.486s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:29 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-27332509-0b8b-4557-ab4d-c9a542b2423e tempest-VolumesGetTest-1117816825 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:29 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-27332509-0b8b-4557-ab4d-c9a542b2423e tempest-VolumesGetTest-1117816825 None] Deleted volume successfully. Apr 10 10:38:29 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-27332509-0b8b-4557-ab4d-c9a542b2423e tempest-VolumesGetTest-1117816825 None] Lock "cinder-e4d4a9ce-9e1d-47f6-992b-92c5a420417f-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] Flow 'volume_create_manager' (2845e715-0e9a-4b66-bc67-ebaa604d5e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd258fc-93a7-4ee3-b35b-1153a4a19937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd258fc-93a7-4ee3-b35b-1153a4a19937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2043142855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e11f81a4-eacd-44bf-a096-00b52c3e40d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e24e3640a244eba62916ade4e82102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:30Z,use_quota=True,user_id='c1c452dfd2224da7b87d00a43db817a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76aaccbc-c40e-47dd-a90c-fd33d7eab5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76aaccbc-c40e-47dd-a90c-fd33d7eab5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (165d3f04-c8c9-4211-8267-87068fa16aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (165d3f04-c8c9-4211-8267-87068fa16aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e11f81a4-eacd-44bf-a096-00b52c3e40d0', 'volume_name': 'volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7146ac1-68a8-453d-a1cc-b42284750517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7146ac1-68a8-453d-a1cc-b42284750517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47671f1-e1ba-4d8d-bee0-c87941cf9448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:30 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] Volume e11f81a4-eacd-44bf-a096-00b52c3e40d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0', 'volume_size': 1} Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2043142855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e11f81a4-eacd-44bf-a096-00b52c3e40d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e24e3640a244eba62916ade4e82102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:30Z,use_quota=True,user_id='c1c452dfd2224da7b87d00a43db817a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] Creating volume e11f81a4-eacd-44bf-a096-00b52c3e40d0 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:30 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:30 devstack sudo[87691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0 1073741824 Apr 10 10:38:30 devstack sudo[87691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b6e455b9-9806-48bd-9cd7-9d86e0eb7c49 tempest-VolumesGetTest-1117816825 None] Acquiring lock "cinder-26275c69-5179-4e38-8e1a-8d903875a873-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b6e455b9-9806-48bd-9cd7-9d86e0eb7c49 tempest-VolumesGetTest-1117816825 None] Lock "cinder-26275c69-5179-4e38-8e1a-8d903875a873-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b6e455b9-9806-48bd-9cd7-9d86e0eb7c49 tempest-VolumesGetTest-1117816825 None] Acquiring lock "cinder-quobyte-26275c69-5179-4e38-8e1a-8d903875a873" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b6e455b9-9806-48bd-9cd7-9d86e0eb7c49 tempest-VolumesGetTest-1117816825 None] Lock "cinder-quobyte-26275c69-5179-4e38-8e1a-8d903875a873" acquired by "delete_volume" :: waited 0.012s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[838fc164-7841-471d-be51-c5312ff30e91]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b6e455b9-9806-48bd-9cd7-9d86e0eb7c49 tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-26275c69-5179-4e38-8e1a-8d903875a873 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:30 devstack sudo[87693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-26275c69-5179-4e38-8e1a-8d903875a873 Apr 10 10:38:30 devstack sudo[87693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:30 devstack sudo[87691]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0 1073741824" returned: 0 in 0.631s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:30 devstack sudo[87698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0 Apr 10 10:38:30 devstack sudo[87698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:30 devstack sudo[87693]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b6e455b9-9806-48bd-9cd7-9d86e0eb7c49 tempest-VolumesGetTest-1117816825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-26275c69-5179-4e38-8e1a-8d903875a873" returned: 0 in 0.616s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b6e455b9-9806-48bd-9cd7-9d86e0eb7c49 tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-26275c69-5179-4e38-8e1a-8d903875a873 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:30 devstack sudo[87703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-26275c69-5179-4e38-8e1a-8d903875a873 Apr 10 10:38:30 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7a52d5a4-7522-44c8-a2ab-d94057805177 tempest-VolumesActionsTest-583784559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:31 devstack sudo[87698]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0" returned: 0 in 0.550s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:31 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7a52d5a4-7522-44c8-a2ab-d94057805177 tempest-VolumesActionsTest-583784559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.102s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:31 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47671f1-e1ba-4d8d-bee0-c87941cf9448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:31 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e6b51e3-a980-4aeb-be57-08831718ddea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:31 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[914b52df-9120-4fdc-a2fd-78217a00e2fa]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7a52d5a4-7522-44c8-a2ab-d94057805177 tempest-VolumesActionsTest-583784559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:31 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] Volume volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0 (e11f81a4-eacd-44bf-a096-00b52c3e40d0): created successfully Apr 10 10:38:31 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e6b51e3-a980-4aeb-be57-08831718ddea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:31 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] Flow 'volume_create_manager' (2845e715-0e9a-4b66-bc67-ebaa604d5e26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:31 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-46b1c6a5-63a4-4156-bba5-699c6c847590 tempest-VolumeDependencyTests-1654235345 None] Created volume successfully. Apr 10 10:38:31 devstack sudo[87708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f Apr 10 10:38:31 devstack sudo[87708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:31 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b6e455b9-9806-48bd-9cd7-9d86e0eb7c49 tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-26275c69-5179-4e38-8e1a-8d903875a873" returned: 0 in 0.510s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:31 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b6e455b9-9806-48bd-9cd7-9d86e0eb7c49 tempest-VolumesGetTest-1117816825 None] Lock "cinder-quobyte-26275c69-5179-4e38-8e1a-8d903875a873" released by "delete_volume" :: held 1.151s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:31 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-b6e455b9-9806-48bd-9cd7-9d86e0eb7c49 tempest-VolumesGetTest-1117816825 None] Created reservations ['10b24153-7433-4f2e-a4fd-4852cf05b332', '8b3cfb78-0315-4631-8abe-d36bd53297e1', 'ad377904-53b1-4319-bfe8-fd8e1659d41f', 'c6931efb-f1b2-4821-9a66-1eaef9adf485'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b6e455b9-9806-48bd-9cd7-9d86e0eb7c49 tempest-VolumesGetTest-1117816825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b6e455b9-9806-48bd-9cd7-9d86e0eb7c49 tempest-VolumesGetTest-1117816825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:31 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b6e455b9-9806-48bd-9cd7-9d86e0eb7c49 tempest-VolumesGetTest-1117816825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:31 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b6e455b9-9806-48bd-9cd7-9d86e0eb7c49 tempest-VolumesGetTest-1117816825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b6e455b9-9806-48bd-9cd7-9d86e0eb7c49 tempest-VolumesGetTest-1117816825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b6e455b9-9806-48bd-9cd7-9d86e0eb7c49 tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:31 devstack sudo[87711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:38:31 devstack sudo[87711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:31 devstack sudo[87708]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7a52d5a4-7522-44c8-a2ab-d94057805177 tempest-VolumesActionsTest-583784559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f" returned: 0 in 0.517s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:31 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74a93bd-3168-4bff-a187-809bb2d731ad]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7a52d5a4-7522-44c8-a2ab-d94057805177 tempest-VolumesActionsTest-583784559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:31 devstack sudo[87716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f Apr 10 10:38:31 devstack sudo[87716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:32 devstack sudo[87711]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b6e455b9-9806-48bd-9cd7-9d86e0eb7c49 tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.468s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:32 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-b6e455b9-9806-48bd-9cd7-9d86e0eb7c49 tempest-VolumesGetTest-1117816825 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:32 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-b6e455b9-9806-48bd-9cd7-9d86e0eb7c49 tempest-VolumesGetTest-1117816825 None] Deleted volume successfully. Apr 10 10:38:32 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b6e455b9-9806-48bd-9cd7-9d86e0eb7c49 tempest-VolumesGetTest-1117816825 None] Lock "cinder-26275c69-5179-4e38-8e1a-8d903875a873-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8b11b27d-86cf-4aad-b0d2-920828a59011 tempest-VolumeDependencyTests-1654235345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:32 devstack sudo[87716]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7a52d5a4-7522-44c8-a2ab-d94057805177 tempest-VolumesActionsTest-583784559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f" returned: 0 in 0.511s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7a52d5a4-7522-44c8-a2ab-d94057805177 tempest-VolumesActionsTest-583784559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f /opt/stack/data/cinder/conversion/b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f.temp_image.7922d781-0458-4867-973b-63dd1aa28a24j48vr2ds.img {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:32 devstack sudo[87722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f /opt/stack/data/cinder/conversion/b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f.temp_image.7922d781-0458-4867-973b-63dd1aa28a24j48vr2ds.img Apr 10 10:38:32 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:32 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a25cde36-5c81-405c-8a3e-6d274df3eeea tempest-VolumesGetTest-1117816825 None] Acquiring lock "cinder-5be19908-f9d7-4953-927d-ece7e92ab2cd-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:32 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a25cde36-5c81-405c-8a3e-6d274df3eeea tempest-VolumesGetTest-1117816825 None] Lock "cinder-5be19908-f9d7-4953-927d-ece7e92ab2cd-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:32 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a25cde36-5c81-405c-8a3e-6d274df3eeea tempest-VolumesGetTest-1117816825 None] Acquiring lock "cinder-quobyte-5be19908-f9d7-4953-927d-ece7e92ab2cd" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:32 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a25cde36-5c81-405c-8a3e-6d274df3eeea tempest-VolumesGetTest-1117816825 None] Lock "cinder-quobyte-5be19908-f9d7-4953-927d-ece7e92ab2cd" acquired by "delete_volume" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:32 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[287dc7d8-be69-4ded-ac69-389a9e71fb08]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a25cde36-5c81-405c-8a3e-6d274df3eeea tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:32 devstack sudo[87724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd Apr 10 10:38:32 devstack sudo[87724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:33 devstack sudo[87724]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a25cde36-5c81-405c-8a3e-6d274df3eeea tempest-VolumesGetTest-1117816825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd" returned: 0 in 1.200s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a25cde36-5c81-405c-8a3e-6d274df3eeea tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:33 devstack sudo[87739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd Apr 10 10:38:33 devstack sudo[87739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:34 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7a52d5a4-7522-44c8-a2ab-d94057805177 tempest-VolumesActionsTest-583784559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f /opt/stack/data/cinder/conversion/b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f.temp_image.7922d781-0458-4867-973b-63dd1aa28a24j48vr2ds.img" returned: 0 in 2.151s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:34 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[141fdfc8-2b1e-4b87-9804-c0ccee202658]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7a52d5a4-7522-44c8-a2ab-d94057805177 tempest-VolumesActionsTest-583784559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:34 devstack sudo[87741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f Apr 10 10:38:34 devstack sudo[87741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:34 devstack sudo[87739]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a25cde36-5c81-405c-8a3e-6d274df3eeea tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5be19908-f9d7-4953-927d-ece7e92ab2cd" returned: 0 in 0.870s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:34 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a25cde36-5c81-405c-8a3e-6d274df3eeea tempest-VolumesGetTest-1117816825 None] Lock "cinder-quobyte-5be19908-f9d7-4953-927d-ece7e92ab2cd" released by "delete_volume" :: held 2.112s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:34 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-a25cde36-5c81-405c-8a3e-6d274df3eeea tempest-VolumesGetTest-1117816825 None] Created reservations ['9eb692e3-4a99-48de-b740-3a454959a533', 'a8b3a3aa-2de4-4c6c-b738-9082b06df00e', '011b6d0f-736c-4a41-88e4-d408fad10e3a', 'c8b55cbd-9ec6-48ef-8286-a7f24a7164d4'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a25cde36-5c81-405c-8a3e-6d274df3eeea tempest-VolumesGetTest-1117816825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a25cde36-5c81-405c-8a3e-6d274df3eeea tempest-VolumesGetTest-1117816825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:34 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a25cde36-5c81-405c-8a3e-6d274df3eeea tempest-VolumesGetTest-1117816825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:34 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a25cde36-5c81-405c-8a3e-6d274df3eeea tempest-VolumesGetTest-1117816825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a25cde36-5c81-405c-8a3e-6d274df3eeea tempest-VolumesGetTest-1117816825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a25cde36-5c81-405c-8a3e-6d274df3eeea tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:34 devstack sudo[87744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:38:34 devstack sudo[87744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:35 devstack sudo[87741]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7a52d5a4-7522-44c8-a2ab-d94057805177 tempest-VolumesActionsTest-583784559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f" returned: 0 in 0.715s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:35 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-7a52d5a4-7522-44c8-a2ab-d94057805177 tempest-VolumesActionsTest-583784559 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f, size 1024.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/conversion/b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f.temp_image.7922d781-0458-4867-973b-63dd1aa28a24j48vr2ds.img {{(pid=81938) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:38:35 devstack cinder-volume[81938]: INFO cinder.image.image_utils [None req-7a52d5a4-7522-44c8-a2ab-d94057805177 tempest-VolumesActionsTest-583784559 None] Converted 1024.00 MB image at 475.77 MB/s Apr 10 10:38:35 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-7a52d5a4-7522-44c8-a2ab-d94057805177 tempest-VolumesActionsTest-583784559 None] 7922d781-0458-4867-973b-63dd1aa28a24 was raw, no need to convert to raw {{(pid=81938) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 10 10:38:35 devstack sudo[87744]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a25cde36-5c81-405c-8a3e-6d274df3eeea tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.571s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:35 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-a25cde36-5c81-405c-8a3e-6d274df3eeea tempest-VolumesGetTest-1117816825 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:35 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-a25cde36-5c81-405c-8a3e-6d274df3eeea tempest-VolumesGetTest-1117816825 None] Deleted volume successfully. Apr 10 10:38:35 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Flow 'volume_create_manager' (f731f6a1-5738-4af0-9274-5874a5fd25ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0621bb-521c-4bd7-ac42-cc892695266f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0621bb-521c-4bd7-ac42-cc892695266f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-793856358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be98e15c-67ea-4f80-b72f-e78c722a5d28,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='69a9c60134b743c9856d1cc12e58ad43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:35Z,use_quota=True,user_id='99b2c59b40aa4ed6925ceb4e538b7ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c753c0e-2583-4608-9b41-65d2d19cbe33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c753c0e-2583-4608-9b41-65d2d19cbe33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5dd0a38-cb5a-4c3f-ba45-af800ccd656e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:35 devstack cinder-volume[81938]: DEBUG cinder.image.glance [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Creating Keystone auth plugin from conf {{(pid=81938) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 10 10:38:35 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a25cde36-5c81-405c-8a3e-6d274df3eeea tempest-VolumesGetTest-1117816825 None] Lock "cinder-5be19908-f9d7-4953-927d-ece7e92ab2cd-delete_volume" released by "delete_volume" :: held 2.896s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5dd0a38-cb5a-4c3f-ba45-af800ccd656e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'be98e15c-67ea-4f80-b72f-e78c722a5d28', 'volume_name': 'volume-be98e15c-67ea-4f80-b72f-e78c722a5d28', 'volume_size': 1, 'image_id': '8dcf7229-52df-43f5-84c5-2e0276bc541d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf7229-52df-43f5-84c5-2e0276bc541d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '52e7a0ecf90345dca974afb11cfc67b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8dcf7229-52df-43f5-84c5-2e0276bc541d', 'created_at': datetime.datetime(2026, 4, 10, 8, 27, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 27, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dcf7229-52df-43f5-84c5-2e0276bc541d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ebdfb4f-fd1f-4a52-8f78-d19b7081546e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ebdfb4f-fd1f-4a52-8f78-d19b7081546e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4fb3a85-8b07-4d3a-8ddd-aeade4ef9690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:35 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Volume be98e15c-67ea-4f80-b72f-e78c722a5d28: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-be98e15c-67ea-4f80-b72f-e78c722a5d28', 'volume_size': 1, 'image_id': '8dcf7229-52df-43f5-84c5-2e0276bc541d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf7229-52df-43f5-84c5-2e0276bc541d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '52e7a0ecf90345dca974afb11cfc67b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8dcf7229-52df-43f5-84c5-2e0276bc541d', 'created_at': datetime.datetime(2026, 4, 10, 8, 27, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 27, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dcf7229-52df-43f5-84c5-2e0276bc541d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 10 10:38:35 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Trying to clone be98e15c-67ea-4f80-b72f-e78c722a5d28 from image 8dcf7229-52df-43f5-84c5-2e0276bc541d at location (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf7229-52df-43f5-84c5-2e0276bc541d', 'metadata': {}}]). {{(pid=81938) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 10 10:38:35 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_i8bex16cdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81938) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 10 10:38:35 devstack cinder-volume[81938]: INFO cinder.image.image_utils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Image download 20.69 MB at 20.69 MB/s Apr 10 10:38:35 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fb618d-d92a-4f46-abd6-d064095bada9]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_i8bex16cdevstack@QuobyteHD {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:35 devstack sudo[87751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_i8bex16cdevstack@QuobyteHD Apr 10 10:38:35 devstack sudo[87751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:36 devstack sudo[87751]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_i8bex16cdevstack@QuobyteHD" returned: 0 in 0.537s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:36 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Temporary image 8dcf7229-52df-43f5-84c5-2e0276bc541d is fetched for user 99b2c59b40aa4ed6925ceb4e538b7ad2. {{(pid=81938) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 10 10:38:36 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[93891336-92a8-466e-aa04-6f28ce6cf4b9]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_i8bex16cdevstack@QuobyteHD {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:36 devstack sudo[87756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_i8bex16cdevstack@QuobyteHD Apr 10 10:38:36 devstack sudo[87756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:37 devstack sudo[87756]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_i8bex16cdevstack@QuobyteHD" returned: 0 in 0.550s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:45 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writing DB stats cinder:UPDATE=65,cinder:SELECT=43,cinder:INSERT=13,cinder:DELETE=6 {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:38:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7a52d5a4-7522-44c8-a2ab-d94057805177 tempest-VolumesActionsTest-583784559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.685s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7a52d5a4-7522-44c8-a2ab-d94057805177 tempest-VolumesActionsTest-583784559 None] Uploaded volume to glance image-id: 7922d781-0458-4867-973b-63dd1aa28a24. {{(pid=81938) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 10 10:38:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8b11b27d-86cf-4aad-b0d2-920828a59011 tempest-VolumeDependencyTests-1654235345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.745s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:46 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-8b11b27d-86cf-4aad-b0d2-920828a59011 tempest-VolumeDependencyTests-1654235345 None] Creating offline snapshot 797f96b2-7f4f-470e-8ec7-469242065e98 of volume e11f81a4-eacd-44bf-a096-00b52c3e40d0 {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:38:46 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-7a52d5a4-7522-44c8-a2ab-d94057805177 tempest-VolumesActionsTest-583784559 None] Copy volume to image completed successfully. Apr 10 10:38:46 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[d905858c-2f9f-45c8-acbb-d8d4bbc5e77c]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8b11b27d-86cf-4aad-b0d2-920828a59011 tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:46 devstack sudo[87762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0 Apr 10 10:38:46 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:46 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8b11b27d-86cf-4aad-b0d2-920828a59011 tempest-VolumeDependencyTests-1654235345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0" returned: 0 in 0.483s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8b11b27d-86cf-4aad-b0d2-920828a59011 tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0.797f96b2-7f4f-470e-8ec7-469242065e98 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:46 devstack sudo[87767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0.797f96b2-7f4f-470e-8ec7-469242065e98 1G Apr 10 10:38:46 devstack sudo[87767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:47 devstack sudo[87767]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8b11b27d-86cf-4aad-b0d2-920828a59011 tempest-VolumeDependencyTests-1654235345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0.797f96b2-7f4f-470e-8ec7-469242065e98 1G" returned: 0 in 0.574s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8b11b27d-86cf-4aad-b0d2-920828a59011 tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0.797f96b2-7f4f-470e-8ec7-469242065e98 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:47 devstack sudo[87772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0.797f96b2-7f4f-470e-8ec7-469242065e98 Apr 10 10:38:47 devstack sudo[87772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6fb142ba-57eb-478c-b4fb-2b6d85716128 tempest-VolumesActionsTest-583784559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:47 devstack sudo[87772]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8b11b27d-86cf-4aad-b0d2-920828a59011 tempest-VolumeDependencyTests-1654235345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0.797f96b2-7f4f-470e-8ec7-469242065e98" returned: 0 in 0.510s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:47 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-8b11b27d-86cf-4aad-b0d2-920828a59011 tempest-VolumeDependencyTests-1654235345 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0.797f96b2-7f4f-470e-8ec7-469242065e98 is being set with open permissions: ugo+rw Apr 10 10:38:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8b11b27d-86cf-4aad-b0d2-920828a59011 tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0.797f96b2-7f4f-470e-8ec7-469242065e98 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:47 devstack sudo[87777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0.797f96b2-7f4f-470e-8ec7-469242065e98 Apr 10 10:38:47 devstack sudo[87777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:48 devstack sudo[87777]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8b11b27d-86cf-4aad-b0d2-920828a59011 tempest-VolumeDependencyTests-1654235345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0.797f96b2-7f4f-470e-8ec7-469242065e98" returned: 0 in 0.435s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8b11b27d-86cf-4aad-b0d2-920828a59011 tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:48 devstack cinder-volume[81938]: DEBUG oslo_service.periodic_task [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81938) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:38:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:48 devstack sudo[87780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0.info Apr 10 10:38:48 devstack sudo[87780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:48 devstack sudo[87782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:38:48 devstack sudo[87782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:48 devstack sudo[87780]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8b11b27d-86cf-4aad-b0d2-920828a59011 tempest-VolumeDependencyTests-1654235345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0.info" returned: 0 in 0.459s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:48 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-8b11b27d-86cf-4aad-b0d2-920828a59011 tempest-VolumeDependencyTests-1654235345 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0.info is being set with open permissions: ugo+rw Apr 10 10:38:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8b11b27d-86cf-4aad-b0d2-920828a59011 tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:48 devstack sudo[87786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0.info Apr 10 10:38:48 devstack sudo[87786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:48 devstack sudo[87782]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.486s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:48 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:48 devstack sudo[87786]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8b11b27d-86cf-4aad-b0d2-920828a59011 tempest-VolumeDependencyTests-1654235345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0.info" returned: 0 in 0.476s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8b11b27d-86cf-4aad-b0d2-920828a59011 tempest-VolumeDependencyTests-1654235345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.970s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:49 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-793856358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be98e15c-67ea-4f80-b72f-e78c722a5d28,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='69a9c60134b743c9856d1cc12e58ad43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:35Z,use_quota=True,user_id='99b2c59b40aa4ed6925ceb4e538b7ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:49 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Creating volume be98e15c-67ea-4f80-b72f-e78c722a5d28 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:49 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:49 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:49 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:49 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:38:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-be98e15c-67ea-4f80-b72f-e78c722a5d28 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:49 devstack sudo[87795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-be98e15c-67ea-4f80-b72f-e78c722a5d28 1073741824 Apr 10 10:38:49 devstack sudo[87795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:49 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-8b11b27d-86cf-4aad-b0d2-920828a59011 tempest-VolumeDependencyTests-1654235345 None] Create snapshot completed successfully Apr 10 10:38:49 devstack sudo[87795]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-be98e15c-67ea-4f80-b72f-e78c722a5d28 1073741824" returned: 0 in 0.514s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-be98e15c-67ea-4f80-b72f-e78c722a5d28 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:49 devstack sudo[87800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-be98e15c-67ea-4f80-b72f-e78c722a5d28 Apr 10 10:38:49 devstack sudo[87800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:49 devstack sudo[87800]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-be98e15c-67ea-4f80-b72f-e78c722a5d28" returned: 0 in 0.423s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:49 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6fb142ba-57eb-478c-b4fb-2b6d85716128 tempest-VolumesActionsTest-583784559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.473s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:49 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca9e739-be16-49c0-ab9a-6a427d80c335]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6fb142ba-57eb-478c-b4fb-2b6d85716128 tempest-VolumesActionsTest-583784559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:50 devstack cinder-volume[81938]: DEBUG cinder.volume.volume_utils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Attempting download of 8dcf7229-52df-43f5-84c5-2e0276bc541d ((None, [{'url': 'file:///opt/stack/data/glance/images/8dcf7229-52df-43f5-84c5-2e0276bc541d', 'metadata': {}}])) to volume be98e15c-67ea-4f80-b72f-e78c722a5d28. {{(pid=81938) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 10 10:38:50 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8bf908-c342-470f-a98b-0854cfc61472]: (4, 'raw') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dcf7229-52df-43f5-84c5-2e0276bc541d_q0ql4fwb {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:50 devstack sudo[87804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f Apr 10 10:38:50 devstack sudo[87804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:50 devstack sudo[87805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dcf7229-52df-43f5-84c5-2e0276bc541d_q0ql4fwb Apr 10 10:38:50 devstack sudo[87805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:50 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Flow 'volume_create_manager' (6d833e2f-aa83-4e7e-8711-2cd70a3d8e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adbe577d-903a-42de-8c22-7e6dd3fb314c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:50 devstack sudo[87804]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adbe577d-903a-42de-8c22-7e6dd3fb314c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1407211136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b295f0-f306-4ba2-aac5-b5bfd756432c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e24e3640a244eba62916ade4e82102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=797f96b2-7f4f-470e-8ec7-469242065e98,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:50Z,use_quota=True,user_id='c1c452dfd2224da7b87d00a43db817a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5da99a41-f714-4be6-add7-429915ebedbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5da99a41-f714-4be6-add7-429915ebedbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b37004f2-d1da-4bfe-9031-f84204e6df2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b37004f2-d1da-4bfe-9031-f84204e6df2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f6b295f0-f306-4ba2-aac5-b5bfd756432c', 'volume_name': 'volume-f6b295f0-f306-4ba2-aac5-b5bfd756432c', 'volume_size': 1, 'snapshot_id': '797f96b2-7f4f-470e-8ec7-469242065e98'}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7628d07f-5f45-4872-a60f-fce12b8e9a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7628d07f-5f45-4872-a60f-fce12b8e9a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc47390-c937-4d74-a8f2-d7f8dfb6d85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:50 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Volume f6b295f0-f306-4ba2-aac5-b5bfd756432c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f6b295f0-f306-4ba2-aac5-b5bfd756432c', 'volume_size': 1, 'snapshot_id': '797f96b2-7f4f-470e-8ec7-469242065e98'} Apr 10 10:38:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6fb142ba-57eb-478c-b4fb-2b6d85716128 tempest-VolumesActionsTest-583784559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f" returned: 0 in 0.581s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:50 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8386682-b2c0-40f3-afc4-e81123ee27a7]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6fb142ba-57eb-478c-b4fb-2b6d85716128 tempest-VolumesActionsTest-583784559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:50 devstack sudo[87811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f Apr 10 10:38:50 devstack sudo[87811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:50 devstack sudo[87805]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dcf7229-52df-43f5-84c5-2e0276bc541d_q0ql4fwb" returned: 0 in 0.642s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf7229-52df-43f5-84c5-2e0276bc541d_q0ql4fwb {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:50 devstack sudo[87815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf7229-52df-43f5-84c5-2e0276bc541d_q0ql4fwb Apr 10 10:38:50 devstack sudo[87815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:51 devstack sudo[87811]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6fb142ba-57eb-478c-b4fb-2b6d85716128 tempest-VolumesActionsTest-583784559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f" returned: 0 in 0.535s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6fb142ba-57eb-478c-b4fb-2b6d85716128 tempest-VolumesActionsTest-583784559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f /opt/stack/data/cinder/conversion/b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f.temp_image.83693b95-5542-4214-8eb2-fa205402806f3ea9hbkb.img {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:51 devstack sudo[87820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f /opt/stack/data/cinder/conversion/b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f.temp_image.83693b95-5542-4214-8eb2-fa205402806f3ea9hbkb.img Apr 10 10:38:51 devstack sudo[87820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:51 devstack sudo[87815]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf7229-52df-43f5-84c5-2e0276bc541d_q0ql4fwb" returned: 1 in 0.523s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf7229-52df-43f5-84c5-2e0276bc541d_q0ql4fwb' failed. Not Retrying. {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:38:51 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[32071c60-1276-4728-baac-fb1379fc8a53]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_i8bex16cdevstack@QuobyteHD {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:51 devstack sudo[87824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_i8bex16cdevstack@QuobyteHD Apr 10 10:38:51 devstack sudo[87824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:52 devstack sudo[87824]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_i8bex16cdevstack@QuobyteHD" returned: 0 in 0.852s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:52 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] 8dcf7229-52df-43f5-84c5-2e0276bc541d was qcow2, converting to raw {{(pid=81938) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 10 10:38:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_i8bex16cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-be98e15c-67ea-4f80-b72f-e78c722a5d28 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:52 devstack sudo[87839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_i8bex16cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-be98e15c-67ea-4f80-b72f-e78c722a5d28 Apr 10 10:38:52 devstack sudo[87839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:53 devstack sudo[87820]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6fb142ba-57eb-478c-b4fb-2b6d85716128 tempest-VolumesActionsTest-583784559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f /opt/stack/data/cinder/conversion/b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f.temp_image.83693b95-5542-4214-8eb2-fa205402806f3ea9hbkb.img" returned: 0 in 2.077s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:53 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a38ae5a-9a77-408f-b19d-deb7269aed05]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6fb142ba-57eb-478c-b4fb-2b6d85716128 tempest-VolumesActionsTest-583784559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:53 devstack sudo[87857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f Apr 10 10:38:53 devstack sudo[87857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:53 devstack sudo[87839]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_i8bex16cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-be98e15c-67ea-4f80-b72f-e78c722a5d28" returned: 0 in 1.543s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:53 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8dcf7229-52df-43f5-84c5-2e0276bc541d_i8bex16cdevstack@QuobyteHD, size 112.00 MB, duration 1.54 sec, destination /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-be98e15c-67ea-4f80-b72f-e78c722a5d28 {{(pid=81938) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:38:53 devstack cinder-volume[81938]: INFO cinder.image.image_utils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Converted 112.00 MB image at 72.49 MB/s Apr 10 10:38:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-be98e15c-67ea-4f80-b72f-e78c722a5d28 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:53 devstack sudo[87859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-be98e15c-67ea-4f80-b72f-e78c722a5d28 1G Apr 10 10:38:53 devstack sudo[87859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:53 devstack sudo[87857]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6fb142ba-57eb-478c-b4fb-2b6d85716128 tempest-VolumesActionsTest-583784559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f" returned: 0 in 0.674s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:53 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-6fb142ba-57eb-478c-b4fb-2b6d85716128 tempest-VolumesActionsTest-583784559 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f, size 1024.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/conversion/b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f.temp_image.83693b95-5542-4214-8eb2-fa205402806f3ea9hbkb.img {{(pid=81938) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:38:53 devstack cinder-volume[81938]: INFO cinder.image.image_utils [None req-6fb142ba-57eb-478c-b4fb-2b6d85716128 tempest-VolumesActionsTest-583784559 None] Converted 1024.00 MB image at 492.83 MB/s Apr 10 10:38:53 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-6fb142ba-57eb-478c-b4fb-2b6d85716128 tempest-VolumesActionsTest-583784559 None] 83693b95-5542-4214-8eb2-fa205402806f was raw, converting to qcow2 {{(pid=81938) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 10 10:38:53 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[f442c683-6997-42ac-aea0-dfbe238e8414]: (4, 'raw') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6fb142ba-57eb-478c-b4fb-2b6d85716128 tempest-VolumesActionsTest-583784559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f.temp_image.83693b95-5542-4214-8eb2-fa205402806f3ea9hbkb.img {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:53 devstack sudo[87864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f.temp_image.83693b95-5542-4214-8eb2-fa205402806f3ea9hbkb.img Apr 10 10:38:53 devstack sudo[87864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:54 devstack sudo[87859]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-be98e15c-67ea-4f80-b72f-e78c722a5d28 1G" returned: 0 in 0.536s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:54 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f985c9-689d-4fe4-b2a9-457f0cdace7c]: (4, 'raw') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-be98e15c-67ea-4f80-b72f-e78c722a5d28 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:54 devstack sudo[87870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-be98e15c-67ea-4f80-b72f-e78c722a5d28 Apr 10 10:38:54 devstack sudo[87870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:54 devstack sudo[87864]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6fb142ba-57eb-478c-b4fb-2b6d85716128 tempest-VolumesActionsTest-583784559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f.temp_image.83693b95-5542-4214-8eb2-fa205402806f3ea9hbkb.img" returned: 0 in 0.534s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6fb142ba-57eb-478c-b4fb-2b6d85716128 tempest-VolumesActionsTest-583784559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f.temp_image.83693b95-5542-4214-8eb2-fa205402806f3ea9hbkb.img {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:54 devstack sudo[87874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f.temp_image.83693b95-5542-4214-8eb2-fa205402806f3ea9hbkb.img Apr 10 10:38:54 devstack sudo[87874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:54 devstack sudo[87870]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-be98e15c-67ea-4f80-b72f-e78c722a5d28" returned: 0 in 0.517s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-be98e15c-67ea-4f80-b72f-e78c722a5d28 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:54 devstack sudo[87878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-be98e15c-67ea-4f80-b72f-e78c722a5d28 Apr 10 10:38:54 devstack sudo[87878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:54 devstack sudo[87874]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6fb142ba-57eb-478c-b4fb-2b6d85716128 tempest-VolumesActionsTest-583784559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f.temp_image.83693b95-5542-4214-8eb2-fa205402806f3ea9hbkb.img" returned: 1 in 0.506s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6fb142ba-57eb-478c-b4fb-2b6d85716128 tempest-VolumesActionsTest-583784559 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f.temp_image.83693b95-5542-4214-8eb2-fa205402806f3ea9hbkb.img' failed. Not Retrying. {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:38:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6fb142ba-57eb-478c-b4fb-2b6d85716128 tempest-VolumesActionsTest-583784559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f.temp_image.83693b95-5542-4214-8eb2-fa205402806f3ea9hbkb.img /opt/stack/data/cinder/conversion/vol_upload_zqgifpjb {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:54 devstack sudo[87883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f.temp_image.83693b95-5542-4214-8eb2-fa205402806f3ea9hbkb.img /opt/stack/data/cinder/conversion/vol_upload_zqgifpjb Apr 10 10:38:54 devstack sudo[87883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:55 devstack sudo[87878]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-be98e15c-67ea-4f80-b72f-e78c722a5d28" returned: 1 in 0.548s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-be98e15c-67ea-4f80-b72f-e78c722a5d28' failed. Not Retrying. {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:38:55 devstack cinder-volume[81938]: DEBUG cinder.volume.volume_utils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Downloaded image 8dcf7229-52df-43f5-84c5-2e0276bc541d ((None, [{'url': 'file:///opt/stack/data/glance/images/8dcf7229-52df-43f5-84c5-2e0276bc541d', 'metadata': {}}])) to volume be98e15c-67ea-4f80-b72f-e78c722a5d28 successfully. {{(pid=81938) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 10 10:38:55 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Temporary image 8dcf7229-52df-43f5-84c5-2e0276bc541d for user 99b2c59b40aa4ed6925ceb4e538b7ad2 is deleted. {{(pid=81938) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 10 10:38:55 devstack cinder-volume[81938]: DEBUG cinder.volume.volume_utils [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Marking volume be98e15c-67ea-4f80-b72f-e78c722a5d28 as bootable. {{(pid=81938) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 10 10:38:55 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Copying metadata from image 8dcf7229-52df-43f5-84c5-2e0276bc541d to be98e15c-67ea-4f80-b72f-e78c722a5d28. {{(pid=81938) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 10 10:38:55 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Creating volume glance metadata for volume be98e15c-67ea-4f80-b72f-e78c722a5d28 backed by image 8dcf7229-52df-43f5-84c5-2e0276bc541d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8dcf7229-52df-43f5-84c5-2e0276bc541d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81938) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 10 10:38:55 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4fb3a85-8b07-4d3a-8ddd-aeade4ef9690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be98e15c-67ea-4f80-b72f-e78c722a5d28', 'volume_size': 1, 'image_id': '8dcf7229-52df-43f5-84c5-2e0276bc541d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf7229-52df-43f5-84c5-2e0276bc541d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '52e7a0ecf90345dca974afb11cfc67b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8dcf7229-52df-43f5-84c5-2e0276bc541d', 'created_at': datetime.datetime(2026, 4, 10, 8, 27, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 27, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dcf7229-52df-43f5-84c5-2e0276bc541d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:55 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155446cf-c3ed-4ae8-9b9e-4bae39d00e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:55 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Volume volume-be98e15c-67ea-4f80-b72f-e78c722a5d28 (be98e15c-67ea-4f80-b72f-e78c722a5d28): created successfully Apr 10 10:38:55 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155446cf-c3ed-4ae8-9b9e-4bae39d00e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:55 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Flow 'volume_create_manager' (f731f6a1-5738-4af0-9274-5874a5fd25ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:55 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-c4917644-eb2e-439a-b5c7-78f927d45759 tempest-VolumesGetTest-1117816825 None] Created volume successfully. Apr 10 10:38:55 devstack sudo[87883]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6fb142ba-57eb-478c-b4fb-2b6d85716128 tempest-VolumesActionsTest-583784559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f.temp_image.83693b95-5542-4214-8eb2-fa205402806f3ea9hbkb.img /opt/stack/data/cinder/conversion/vol_upload_zqgifpjb" returned: 0 in 0.493s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:55 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-6fb142ba-57eb-478c-b4fb-2b6d85716128 tempest-VolumesActionsTest-583784559 None] Image conversion details: src /opt/stack/data/cinder/conversion/b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f.temp_image.83693b95-5542-4214-8eb2-fa205402806f3ea9hbkb.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_zqgifpjb {{(pid=81938) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:38:55 devstack cinder-volume[81938]: INFO cinder.image.image_utils [None req-6fb142ba-57eb-478c-b4fb-2b6d85716128 tempest-VolumesActionsTest-583784559 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 10 10:38:55 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f832739-01a3-458f-aa67-c7ce5d00c36d]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6fb142ba-57eb-478c-b4fb-2b6d85716128 tempest-VolumesActionsTest-583784559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_zqgifpjb {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:55 devstack sudo[87891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_zqgifpjb Apr 10 10:38:55 devstack sudo[87891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:56 devstack sudo[87891]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6fb142ba-57eb-478c-b4fb-2b6d85716128 tempest-VolumesActionsTest-583784559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_zqgifpjb" returned: 0 in 0.561s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:56 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] Flow 'volume_create_manager' (dc0233ff-9ca2-48b2-9e94-40d8a660205d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a1334c8-af0c-468a-97a1-ae32192cdcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a1334c8-af0c-468a-97a1-ae32192cdcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1610598322',display_name='tempest-VolumesGetTest-Volume-300356585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=445be02d-d4aa-469d-8285-2c3c9fd7ef20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69a9c60134b743c9856d1cc12e58ad43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:56Z,use_quota=True,user_id='99b2c59b40aa4ed6925ceb4e538b7ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c830e0-7d44-483b-a97f-9282a1442ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c830e0-7d44-483b-a97f-9282a1442ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414bef9c-e33f-443b-8f9c-ddacf6edd952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414bef9c-e33f-443b-8f9c-ddacf6edd952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '445be02d-d4aa-469d-8285-2c3c9fd7ef20', 'volume_name': 'volume-445be02d-d4aa-469d-8285-2c3c9fd7ef20', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0424af89-a219-420c-8d34-297441911154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0424af89-a219-420c-8d34-297441911154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb8aca9-3348-41b1-9bb2-c6b010667cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:56 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] Volume 445be02d-d4aa-469d-8285-2c3c9fd7ef20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-445be02d-d4aa-469d-8285-2c3c9fd7ef20', 'volume_size': 1} Apr 10 10:38:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6fb142ba-57eb-478c-b4fb-2b6d85716128 tempest-VolumesActionsTest-583784559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.989s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:56 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-6fb142ba-57eb-478c-b4fb-2b6d85716128 tempest-VolumesActionsTest-583784559 None] Uploaded volume to glance image-id: 83693b95-5542-4214-8eb2-fa205402806f. {{(pid=81938) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 10 10:38:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.404s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:56 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Acquiring lock "cinder-quobyte-797f96b2-7f4f-470e-8ec7-469242065e98-f6b295f0-f306-4ba2-aac5-b5bfd756432c" by "_create_volume_from_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:56 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Lock "cinder-quobyte-797f96b2-7f4f-470e-8ec7-469242065e98-f6b295f0-f306-4ba2-aac5-b5bfd756432c" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:56 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Creating volume f6b295f0-f306-4ba2-aac5-b5bfd756432c from snapshot 797f96b2-7f4f-470e-8ec7-469242065e98 {{(pid=81938) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 10:38:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:56 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:56 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:56 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:56 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Acquiring lock "cinder-quobyte-f6b295f0-f306-4ba2-aac5-b5bfd756432c" by "_copy_volume_from_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:57 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-6fb142ba-57eb-478c-b4fb-2b6d85716128 tempest-VolumesActionsTest-583784559 None] Copy volume to image completed successfully. Apr 10 10:38:57 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Lock "cinder-quobyte-f6b295f0-f306-4ba2-aac5-b5bfd756432c" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:57 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] snapshot: 797f96b2-7f4f-470e-8ec7-469242065e98, volume: f6b295f0-f306-4ba2-aac5-b5bfd756432c, {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:38:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:57 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:57 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:57 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d86b419-933f-4f2c-8b80-3c48bc132963]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0.797f96b2-7f4f-470e-8ec7-469242065e98 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:57 devstack sudo[87896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0.797f96b2-7f4f-470e-8ec7-469242065e98 Apr 10 10:38:57 devstack sudo[87896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:57 devstack sudo[87896]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0.797f96b2-7f4f-470e-8ec7-469242065e98" returned: 0 in 0.496s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:57 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:57 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0 {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:38:57 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Creating direct copy from snapshot {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:38:57 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c452e0-46fe-4436-935a-ba50e0641841]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:57 devstack sudo[87933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0 Apr 10 10:38:57 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:58 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0" returned: 0 in 0.532s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:58 devstack cinder-volume[81938]: DEBUG cinder.utils [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Path /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f6b295f0-f306-4ba2-aac5-b5bfd756432c not found in is_blk_device check {{(pid=81938) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:38:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f6b295f0-f306-4ba2-aac5-b5bfd756432c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:58 devstack sudo[87940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f6b295f0-f306-4ba2-aac5-b5bfd756432c Apr 10 10:38:58 devstack sudo[87940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:58 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-37c2f5ef-b856-441f-95d2-da8650bff0bd tempest-VolumesActionsTest-583784559 None] Acquiring lock "cinder-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:58 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-37c2f5ef-b856-441f-95d2-da8650bff0bd tempest-VolumesActionsTest-583784559 None] Lock "cinder-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:58 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-37c2f5ef-b856-441f-95d2-da8650bff0bd tempest-VolumesActionsTest-583784559 None] Acquiring lock "cinder-quobyte-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:58 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-37c2f5ef-b856-441f-95d2-da8650bff0bd tempest-VolumesActionsTest-583784559 None] Lock "cinder-quobyte-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f" acquired by "delete_volume" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:58 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd17f10-5edc-4c00-b9c2-577e41b78669]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-37c2f5ef-b856-441f-95d2-da8650bff0bd tempest-VolumesActionsTest-583784559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:58 devstack sudo[87942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f Apr 10 10:38:58 devstack sudo[87942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:59 devstack sudo[87942]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-37c2f5ef-b856-441f-95d2-da8650bff0bd tempest-VolumesActionsTest-583784559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f" returned: 0 in 1.251s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-37c2f5ef-b856-441f-95d2-da8650bff0bd tempest-VolumesActionsTest-583784559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:59 devstack sudo[87957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f Apr 10 10:38:59 devstack sudo[87957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:00 devstack sudo[87940]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f6b295f0-f306-4ba2-aac5-b5bfd756432c" returned: 0 in 2.207s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:00 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ef7bf5-ce7f-43c0-bd49-1709ad46d5df]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:00 devstack sudo[87960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0 Apr 10 10:39:00 devstack sudo[87960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:00 devstack sudo[87957]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-37c2f5ef-b856-441f-95d2-da8650bff0bd tempest-VolumesActionsTest-583784559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f" returned: 0 in 0.847s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:00 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-37c2f5ef-b856-441f-95d2-da8650bff0bd tempest-VolumesActionsTest-583784559 None] Lock "cinder-quobyte-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f" released by "delete_volume" :: held 2.122s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:00 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-37c2f5ef-b856-441f-95d2-da8650bff0bd tempest-VolumesActionsTest-583784559 None] Created reservations ['4948f6c3-bed0-46ca-97ac-74cccf465cf2', 'd5c09925-75b4-4231-a95c-23a3a4439549', '510ccb2f-4074-480a-b2d5-451920685be0', 'b1e2f462-5003-4212-8748-9e8e868afaa3'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-37c2f5ef-b856-441f-95d2-da8650bff0bd tempest-VolumesActionsTest-583784559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-37c2f5ef-b856-441f-95d2-da8650bff0bd tempest-VolumesActionsTest-583784559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:00 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-37c2f5ef-b856-441f-95d2-da8650bff0bd tempest-VolumesActionsTest-583784559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:00 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-37c2f5ef-b856-441f-95d2-da8650bff0bd tempest-VolumesActionsTest-583784559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-37c2f5ef-b856-441f-95d2-da8650bff0bd tempest-VolumesActionsTest-583784559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-37c2f5ef-b856-441f-95d2-da8650bff0bd tempest-VolumesActionsTest-583784559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:00 devstack sudo[87963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:39:00 devstack sudo[87963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:00 devstack sudo[87960]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0" returned: 0 in 0.689s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:00 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0, size 1024.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f6b295f0-f306-4ba2-aac5-b5bfd756432c {{(pid=81938) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:39:00 devstack cinder-volume[81938]: INFO cinder.image.image_utils [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Converted 1024.00 MB image at 463.49 MB/s Apr 10 10:39:00 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f6b295f0-f306-4ba2-aac5-b5bfd756432c is being set with open permissions: ugo+rw Apr 10 10:39:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f6b295f0-f306-4ba2-aac5-b5bfd756432c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:01 devstack sudo[87969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f6b295f0-f306-4ba2-aac5-b5bfd756432c Apr 10 10:39:01 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:01 devstack sudo[87963]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-37c2f5ef-b856-441f-95d2-da8650bff0bd tempest-VolumesActionsTest-583784559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.487s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:01 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-37c2f5ef-b856-441f-95d2-da8650bff0bd tempest-VolumesActionsTest-583784559 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:01 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-37c2f5ef-b856-441f-95d2-da8650bff0bd tempest-VolumesActionsTest-583784559 None] Deleted volume successfully. Apr 10 10:39:01 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-37c2f5ef-b856-441f-95d2-da8650bff0bd tempest-VolumesActionsTest-583784559 None] Lock "cinder-b3ffe8e7-3fef-41ca-b4c6-b9c582961a9f-delete_volume" released by "delete_volume" :: held 2.773s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:01 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f6b295f0-f306-4ba2-aac5-b5bfd756432c" returned: 0 in 0.471s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:01 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Lock "cinder-quobyte-f6b295f0-f306-4ba2-aac5-b5bfd756432c" released by "_copy_volume_from_snapshot" :: held 4.452s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:01 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Lock "cinder-quobyte-797f96b2-7f4f-470e-8ec7-469242065e98-f6b295f0-f306-4ba2-aac5-b5bfd756432c" released by "_create_volume_from_snapshot" :: held 4.470s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.490s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.244s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:01 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1610598322',display_name='tempest-VolumesGetTest-Volume-300356585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=445be02d-d4aa-469d-8285-2c3c9fd7ef20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69a9c60134b743c9856d1cc12e58ad43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:56Z,use_quota=True,user_id='99b2c59b40aa4ed6925ceb4e538b7ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:39:01 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] Creating volume 445be02d-d4aa-469d-8285-2c3c9fd7ef20 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:39:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:01 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:01 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:01 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:01 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:39:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-445be02d-d4aa-469d-8285-2c3c9fd7ef20 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:01 devstack sudo[87972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-445be02d-d4aa-469d-8285-2c3c9fd7ef20 1073741824 Apr 10 10:39:01 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc47390-c937-4d74-a8f2-d7f8dfb6d85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6b295f0-f306-4ba2-aac5-b5bfd756432c', 'volume_size': 1, 'snapshot_id': '797f96b2-7f4f-470e-8ec7-469242065e98'}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d8244c-a17d-471b-a73a-136de345d56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:01 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Volume volume-f6b295f0-f306-4ba2-aac5-b5bfd756432c (f6b295f0-f306-4ba2-aac5-b5bfd756432c): created successfully Apr 10 10:39:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d8244c-a17d-471b-a73a-136de345d56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Flow 'volume_create_manager' (6d833e2f-aa83-4e7e-8711-2cd70a3d8e64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:01 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-0e8f221f-a547-48f7-a30b-d47638308cce tempest-VolumeDependencyTests-1654235345 None] Created volume successfully. Apr 10 10:39:02 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-445be02d-d4aa-469d-8285-2c3c9fd7ef20 1073741824" returned: 0 in 0.588s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-445be02d-d4aa-469d-8285-2c3c9fd7ef20 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:02 devstack sudo[87978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-445be02d-d4aa-469d-8285-2c3c9fd7ef20 Apr 10 10:39:02 devstack sudo[87978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:02 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6e95ec9d-1e3c-4a43-81e0-dea6f875590e tempest-VolumeDependencyTests-1654235345 None] Acquiring lock "cinder-797f96b2-7f4f-470e-8ec7-469242065e98-delete_snapshot" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:02 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6e95ec9d-1e3c-4a43-81e0-dea6f875590e tempest-VolumeDependencyTests-1654235345 None] Lock "cinder-797f96b2-7f4f-470e-8ec7-469242065e98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:02 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6e95ec9d-1e3c-4a43-81e0-dea6f875590e tempest-VolumeDependencyTests-1654235345 None] Acquiring lock "cinder-quobyte-e11f81a4-eacd-44bf-a096-00b52c3e40d0" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:02 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6e95ec9d-1e3c-4a43-81e0-dea6f875590e tempest-VolumeDependencyTests-1654235345 None] Lock "cinder-quobyte-e11f81a4-eacd-44bf-a096-00b52c3e40d0" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:02 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6e95ec9d-1e3c-4a43-81e0-dea6f875590e tempest-VolumeDependencyTests-1654235345 None] Acquiring lock "cinder-quobyte-797f96b2-7f4f-470e-8ec7-469242065e98" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:02 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6e95ec9d-1e3c-4a43-81e0-dea6f875590e tempest-VolumeDependencyTests-1654235345 None] Lock "cinder-quobyte-797f96b2-7f4f-470e-8ec7-469242065e98" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:02 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-6e95ec9d-1e3c-4a43-81e0-dea6f875590e tempest-VolumeDependencyTests-1654235345 None] Deleting offline snapshot 797f96b2-7f4f-470e-8ec7-469242065e98 of volume e11f81a4-eacd-44bf-a096-00b52c3e40d0 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:39:02 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-6e95ec9d-1e3c-4a43-81e0-dea6f875590e tempest-VolumeDependencyTests-1654235345 None] snapshot_file for this snap is: volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0.797f96b2-7f4f-470e-8ec7-469242065e98 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:39:02 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77da56a-6a5b-49b1-af9f-2dc052326226]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e95ec9d-1e3c-4a43-81e0-dea6f875590e tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0.797f96b2-7f4f-470e-8ec7-469242065e98 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:02 devstack sudo[87980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0.797f96b2-7f4f-470e-8ec7-469242065e98 Apr 10 10:39:02 devstack sudo[87980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:02 devstack sudo[87978]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-445be02d-d4aa-469d-8285-2c3c9fd7ef20" returned: 0 in 0.516s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:02 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:39:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:02 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb8aca9-3348-41b1-9bb2-c6b010667cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-445be02d-d4aa-469d-8285-2c3c9fd7ef20', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:02 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759aaab5-fa3b-4dca-ab54-c30c7821a317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:02 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] Volume volume-445be02d-d4aa-469d-8285-2c3c9fd7ef20 (445be02d-d4aa-469d-8285-2c3c9fd7ef20): created successfully Apr 10 10:39:02 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759aaab5-fa3b-4dca-ab54-c30c7821a317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:02 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] Flow 'volume_create_manager' (dc0233ff-9ca2-48b2-9e94-40d8a660205d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:02 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-5f7c2b43-b548-4f67-aa36-263ed88ba624 tempest-VolumesGetTest-1117816825 None] Created volume successfully. Apr 10 10:39:03 devstack sudo[87980]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e95ec9d-1e3c-4a43-81e0-dea6f875590e tempest-VolumeDependencyTests-1654235345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0.797f96b2-7f4f-470e-8ec7-469242065e98" returned: 0 in 0.607s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:03 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-6e95ec9d-1e3c-4a43-81e0-dea6f875590e tempest-VolumeDependencyTests-1654235345 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:39:03 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[37de15e1-a225-4899-9481-6517974e38f6]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e95ec9d-1e3c-4a43-81e0-dea6f875590e tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:03 devstack sudo[87986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0 Apr 10 10:39:03 devstack sudo[87986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:03 devstack sudo[87986]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e95ec9d-1e3c-4a43-81e0-dea6f875590e tempest-VolumeDependencyTests-1654235345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0" returned: 0 in 0.571s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e95ec9d-1e3c-4a43-81e0-dea6f875590e tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0.797f96b2-7f4f-470e-8ec7-469242065e98 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:03 devstack sudo[87992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0.797f96b2-7f4f-470e-8ec7-469242065e98 Apr 10 10:39:03 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:03 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-1202cdf3-234f-4c81-abbf-280a74b5d68d tempest-VolumesGetTest-1117816825 None] Acquiring lock "cinder-445be02d-d4aa-469d-8285-2c3c9fd7ef20-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:03 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-1202cdf3-234f-4c81-abbf-280a74b5d68d tempest-VolumesGetTest-1117816825 None] Lock "cinder-445be02d-d4aa-469d-8285-2c3c9fd7ef20-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:03 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-1202cdf3-234f-4c81-abbf-280a74b5d68d tempest-VolumesGetTest-1117816825 None] Acquiring lock "cinder-quobyte-445be02d-d4aa-469d-8285-2c3c9fd7ef20" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:03 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-1202cdf3-234f-4c81-abbf-280a74b5d68d tempest-VolumesGetTest-1117816825 None] Lock "cinder-quobyte-445be02d-d4aa-469d-8285-2c3c9fd7ef20" acquired by "delete_volume" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:03 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[105e1d2b-f5db-457a-8721-cf7a3f4fae96]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1202cdf3-234f-4c81-abbf-280a74b5d68d tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-445be02d-d4aa-469d-8285-2c3c9fd7ef20 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:04 devstack sudo[87994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-445be02d-d4aa-469d-8285-2c3c9fd7ef20 Apr 10 10:39:04 devstack sudo[87994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:04 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e95ec9d-1e3c-4a43-81e0-dea6f875590e tempest-VolumeDependencyTests-1654235345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0.797f96b2-7f4f-470e-8ec7-469242065e98" returned: 0 in 0.608s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e95ec9d-1e3c-4a43-81e0-dea6f875590e tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0.797f96b2-7f4f-470e-8ec7-469242065e98 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:04 devstack sudo[87999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0.797f96b2-7f4f-470e-8ec7-469242065e98 Apr 10 10:39:04 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:04 devstack sudo[87994]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1202cdf3-234f-4c81-abbf-280a74b5d68d tempest-VolumesGetTest-1117816825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-445be02d-d4aa-469d-8285-2c3c9fd7ef20" returned: 0 in 0.618s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1202cdf3-234f-4c81-abbf-280a74b5d68d tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-445be02d-d4aa-469d-8285-2c3c9fd7ef20 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:04 devstack sudo[88004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-445be02d-d4aa-469d-8285-2c3c9fd7ef20 Apr 10 10:39:04 devstack sudo[88004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:04 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6e95ec9d-1e3c-4a43-81e0-dea6f875590e tempest-VolumeDependencyTests-1654235345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0.797f96b2-7f4f-470e-8ec7-469242065e98" returned: 0 in 0.463s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:04 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6e95ec9d-1e3c-4a43-81e0-dea6f875590e tempest-VolumeDependencyTests-1654235345 None] Lock "cinder-quobyte-797f96b2-7f4f-470e-8ec7-469242065e98" released by "_delete_snapshot" :: held 2.304s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:04 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6e95ec9d-1e3c-4a43-81e0-dea6f875590e tempest-VolumeDependencyTests-1654235345 None] Lock "cinder-quobyte-e11f81a4-eacd-44bf-a096-00b52c3e40d0" released by "delete_snapshot" :: held 2.319s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:04 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-6e95ec9d-1e3c-4a43-81e0-dea6f875590e tempest-VolumeDependencyTests-1654235345 None] Created reservations ['5ce3be27-2391-4780-abc7-fd6c166a7905', 'd7674055-9702-45a6-ad6b-fb393f1c0627', '8e0b05a5-7e36-4e4b-8403-c99e37b428a6', '46c10a33-c5c2-4df1-9823-f6f5b996d5dd'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:04 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-6e95ec9d-1e3c-4a43-81e0-dea6f875590e tempest-VolumeDependencyTests-1654235345 None] Delete snapshot completed successfully. Apr 10 10:39:04 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6e95ec9d-1e3c-4a43-81e0-dea6f875590e tempest-VolumeDependencyTests-1654235345 None] Lock "cinder-797f96b2-7f4f-470e-8ec7-469242065e98-delete_snapshot" released by "delete_snapshot" :: held 2.412s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:05 devstack sudo[88004]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1202cdf3-234f-4c81-abbf-280a74b5d68d tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-445be02d-d4aa-469d-8285-2c3c9fd7ef20" returned: 0 in 0.486s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:05 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-1202cdf3-234f-4c81-abbf-280a74b5d68d tempest-VolumesGetTest-1117816825 None] Lock "cinder-quobyte-445be02d-d4aa-469d-8285-2c3c9fd7ef20" released by "delete_volume" :: held 1.128s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:05 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-1202cdf3-234f-4c81-abbf-280a74b5d68d tempest-VolumesGetTest-1117816825 None] Created reservations ['d73aed39-2e54-45ff-80e1-53a5e6857278', 'e55525d3-ccb7-4a10-a9a1-e42a28e83052', 'ab44cb20-9ab0-4b4f-935a-7746d54323c0', '61b039b1-2c91-4498-95de-4f1518d321c9'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1202cdf3-234f-4c81-abbf-280a74b5d68d tempest-VolumesGetTest-1117816825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1202cdf3-234f-4c81-abbf-280a74b5d68d tempest-VolumesGetTest-1117816825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:05 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1202cdf3-234f-4c81-abbf-280a74b5d68d tempest-VolumesGetTest-1117816825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:05 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1202cdf3-234f-4c81-abbf-280a74b5d68d tempest-VolumesGetTest-1117816825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1202cdf3-234f-4c81-abbf-280a74b5d68d tempest-VolumesGetTest-1117816825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1202cdf3-234f-4c81-abbf-280a74b5d68d tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:05 devstack sudo[88008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:39:05 devstack sudo[88008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:05 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-600ee2ef-a056-47ee-9b54-ff1d9a368d18 tempest-VolumeDependencyTests-1654235345 None] Acquiring lock "cinder-e11f81a4-eacd-44bf-a096-00b52c3e40d0-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:05 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-600ee2ef-a056-47ee-9b54-ff1d9a368d18 tempest-VolumeDependencyTests-1654235345 None] Lock "cinder-e11f81a4-eacd-44bf-a096-00b52c3e40d0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:05 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-600ee2ef-a056-47ee-9b54-ff1d9a368d18 tempest-VolumeDependencyTests-1654235345 None] Acquiring lock "cinder-quobyte-e11f81a4-eacd-44bf-a096-00b52c3e40d0" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:05 devstack sudo[88008]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:05 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-600ee2ef-a056-47ee-9b54-ff1d9a368d18 tempest-VolumeDependencyTests-1654235345 None] Lock "cinder-quobyte-e11f81a4-eacd-44bf-a096-00b52c3e40d0" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1202cdf3-234f-4c81-abbf-280a74b5d68d tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.490s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:05 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-1202cdf3-234f-4c81-abbf-280a74b5d68d tempest-VolumesGetTest-1117816825 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:05 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-1202cdf3-234f-4c81-abbf-280a74b5d68d tempest-VolumesGetTest-1117816825 None] Deleted volume successfully. Apr 10 10:39:05 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4f782e-15b2-4fa2-aa20-2d52505f98e7]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-600ee2ef-a056-47ee-9b54-ff1d9a368d18 tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:05 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-1202cdf3-234f-4c81-abbf-280a74b5d68d tempest-VolumesGetTest-1117816825 None] Lock "cinder-445be02d-d4aa-469d-8285-2c3c9fd7ef20-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:05 devstack sudo[88011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0 Apr 10 10:39:05 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:06 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-4ea78602-f71e-40a1-8bcd-c6a8ed04f402 tempest-VolumesGetTest-1117816825 None] Acquiring lock "cinder-be98e15c-67ea-4f80-b72f-e78c722a5d28-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:06 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-4ea78602-f71e-40a1-8bcd-c6a8ed04f402 tempest-VolumesGetTest-1117816825 None] Lock "cinder-be98e15c-67ea-4f80-b72f-e78c722a5d28-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:06 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-4ea78602-f71e-40a1-8bcd-c6a8ed04f402 tempest-VolumesGetTest-1117816825 None] Acquiring lock "cinder-quobyte-be98e15c-67ea-4f80-b72f-e78c722a5d28" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:06 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-4ea78602-f71e-40a1-8bcd-c6a8ed04f402 tempest-VolumesGetTest-1117816825 None] Lock "cinder-quobyte-be98e15c-67ea-4f80-b72f-e78c722a5d28" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:06 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edc4a77-dde3-48d3-a138-2c70e3132e06]: (4, 'raw') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4ea78602-f71e-40a1-8bcd-c6a8ed04f402 tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-be98e15c-67ea-4f80-b72f-e78c722a5d28 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:06 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-600ee2ef-a056-47ee-9b54-ff1d9a368d18 tempest-VolumeDependencyTests-1654235345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0" returned: 0 in 0.610s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-600ee2ef-a056-47ee-9b54-ff1d9a368d18 tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:06 devstack sudo[88016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-be98e15c-67ea-4f80-b72f-e78c722a5d28 Apr 10 10:39:06 devstack sudo[88016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:06 devstack sudo[88018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0 Apr 10 10:39:06 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:06 devstack sudo[88016]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4ea78602-f71e-40a1-8bcd-c6a8ed04f402 tempest-VolumesGetTest-1117816825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-be98e15c-67ea-4f80-b72f-e78c722a5d28" returned: 0 in 0.511s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4ea78602-f71e-40a1-8bcd-c6a8ed04f402 tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-be98e15c-67ea-4f80-b72f-e78c722a5d28 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:06 devstack sudo[88023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-be98e15c-67ea-4f80-b72f-e78c722a5d28 Apr 10 10:39:06 devstack sudo[88023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:06 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-600ee2ef-a056-47ee-9b54-ff1d9a368d18 tempest-VolumeDependencyTests-1654235345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e11f81a4-eacd-44bf-a096-00b52c3e40d0" returned: 0 in 0.537s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:06 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-600ee2ef-a056-47ee-9b54-ff1d9a368d18 tempest-VolumeDependencyTests-1654235345 None] Lock "cinder-quobyte-e11f81a4-eacd-44bf-a096-00b52c3e40d0" released by "delete_volume" :: held 1.199s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:06 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-600ee2ef-a056-47ee-9b54-ff1d9a368d18 tempest-VolumeDependencyTests-1654235345 None] Created reservations ['06f57656-ecfe-4d6a-9b64-00c0cec0f25e', '60fc5320-d9aa-4dae-a369-0a6ff1a7c87e', '82004017-5ebc-49ec-9f87-9959f4a99af7', 'fe54923a-3987-44fe-a075-b4d5149f591e'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-600ee2ef-a056-47ee-9b54-ff1d9a368d18 tempest-VolumeDependencyTests-1654235345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-600ee2ef-a056-47ee-9b54-ff1d9a368d18 tempest-VolumeDependencyTests-1654235345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:06 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-600ee2ef-a056-47ee-9b54-ff1d9a368d18 tempest-VolumeDependencyTests-1654235345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:06 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-600ee2ef-a056-47ee-9b54-ff1d9a368d18 tempest-VolumeDependencyTests-1654235345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-600ee2ef-a056-47ee-9b54-ff1d9a368d18 tempest-VolumeDependencyTests-1654235345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-600ee2ef-a056-47ee-9b54-ff1d9a368d18 tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:06 devstack sudo[88025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:39:06 devstack sudo[88025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:07 devstack sudo[88023]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4ea78602-f71e-40a1-8bcd-c6a8ed04f402 tempest-VolumesGetTest-1117816825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-be98e15c-67ea-4f80-b72f-e78c722a5d28" returned: 1 in 0.541s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4ea78602-f71e-40a1-8bcd-c6a8ed04f402 tempest-VolumesGetTest-1117816825 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-be98e15c-67ea-4f80-b72f-e78c722a5d28' failed. Not Retrying. {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:39:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4ea78602-f71e-40a1-8bcd-c6a8ed04f402 tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-be98e15c-67ea-4f80-b72f-e78c722a5d28 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:07 devstack sudo[88030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-be98e15c-67ea-4f80-b72f-e78c722a5d28 Apr 10 10:39:07 devstack sudo[88030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:07 devstack sudo[88025]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-600ee2ef-a056-47ee-9b54-ff1d9a368d18 tempest-VolumeDependencyTests-1654235345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.492s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:07 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-600ee2ef-a056-47ee-9b54-ff1d9a368d18 tempest-VolumeDependencyTests-1654235345 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:07 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-600ee2ef-a056-47ee-9b54-ff1d9a368d18 tempest-VolumeDependencyTests-1654235345 None] Deleted volume successfully. Apr 10 10:39:07 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-600ee2ef-a056-47ee-9b54-ff1d9a368d18 tempest-VolumeDependencyTests-1654235345 None] Lock "cinder-e11f81a4-eacd-44bf-a096-00b52c3e40d0-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:07 devstack sudo[88030]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4ea78602-f71e-40a1-8bcd-c6a8ed04f402 tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-be98e15c-67ea-4f80-b72f-e78c722a5d28" returned: 0 in 0.457s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:07 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-4ea78602-f71e-40a1-8bcd-c6a8ed04f402 tempest-VolumesGetTest-1117816825 None] Lock "cinder-quobyte-be98e15c-67ea-4f80-b72f-e78c722a5d28" released by "delete_volume" :: held 1.556s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:07 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-4ea78602-f71e-40a1-8bcd-c6a8ed04f402 tempest-VolumesGetTest-1117816825 None] Created reservations ['4da3084c-5db6-48d3-a06a-6d2b175f5ff5', '0cef1917-86ba-4679-aa22-162dd741ce11', '08c27e98-df1f-4aa2-b332-f0fcb20e3fc8', '39f32ffb-5517-4bae-926f-65f6417028dd'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-4ea78602-f71e-40a1-8bcd-c6a8ed04f402 tempest-VolumesGetTest-1117816825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-4ea78602-f71e-40a1-8bcd-c6a8ed04f402 tempest-VolumesGetTest-1117816825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-4ea78602-f71e-40a1-8bcd-c6a8ed04f402 tempest-VolumesGetTest-1117816825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-4ea78602-f71e-40a1-8bcd-c6a8ed04f402 tempest-VolumesGetTest-1117816825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-4ea78602-f71e-40a1-8bcd-c6a8ed04f402 tempest-VolumesGetTest-1117816825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4ea78602-f71e-40a1-8bcd-c6a8ed04f402 tempest-VolumesGetTest-1117816825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:07 devstack sudo[88034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:39:07 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:08 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:08 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] Flow 'volume_create_manager' (5d891084-87f9-42a3-a960-e89196c4b539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:08 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (507b9ce9-7712-4fea-91d3-0d0cb40a3cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:08 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (507b9ce9-7712-4fea-91d3-0d0cb40a3cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-962802462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd113227-b478-48a7-be2b-e4a6da1a2c73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e24e3640a244eba62916ade4e82102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:08Z,use_quota=True,user_id='c1c452dfd2224da7b87d00a43db817a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:08 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca267711-51cc-4855-8da7-57a7b3fad6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:08 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca267711-51cc-4855-8da7-57a7b3fad6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:08 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ffc9d30-c6f0-4b48-ad43-b529aa6794b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:08 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ffc9d30-c6f0-4b48-ad43-b529aa6794b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd113227-b478-48a7-be2b-e4a6da1a2c73', 'volume_name': 'volume-cd113227-b478-48a7-be2b-e4a6da1a2c73', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:08 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e516b9ad-3061-450e-ba21-23fe01b5caf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:08 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e516b9ad-3061-450e-ba21-23fe01b5caf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:08 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e08cd4-30fa-4758-848e-91c03fced0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:08 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] Volume cd113227-b478-48a7-be2b-e4a6da1a2c73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd113227-b478-48a7-be2b-e4a6da1a2c73', 'volume_size': 1} Apr 10 10:39:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:08 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-962802462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd113227-b478-48a7-be2b-e4a6da1a2c73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e24e3640a244eba62916ade4e82102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:08Z,use_quota=True,user_id='c1c452dfd2224da7b87d00a43db817a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:39:08 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] Creating volume cd113227-b478-48a7-be2b-e4a6da1a2c73 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:39:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:08 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:08 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:08 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:08 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:39:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:08 devstack sudo[88036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73 1073741824 Apr 10 10:39:08 devstack sudo[88036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:08 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4ea78602-f71e-40a1-8bcd-c6a8ed04f402 tempest-VolumesGetTest-1117816825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.496s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:08 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-4ea78602-f71e-40a1-8bcd-c6a8ed04f402 tempest-VolumesGetTest-1117816825 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:08 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-4ea78602-f71e-40a1-8bcd-c6a8ed04f402 tempest-VolumesGetTest-1117816825 None] Deleted volume successfully. Apr 10 10:39:08 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-4ea78602-f71e-40a1-8bcd-c6a8ed04f402 tempest-VolumesGetTest-1117816825 None] Lock "cinder-be98e15c-67ea-4f80-b72f-e78c722a5d28-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:08 devstack sudo[88036]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73 1073741824" returned: 0 in 0.601s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:08 devstack sudo[88042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73 Apr 10 10:39:08 devstack sudo[88042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:09 devstack sudo[88042]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73" returned: 0 in 0.598s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:09 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:39:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e08cd4-30fa-4758-848e-91c03fced0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd113227-b478-48a7-be2b-e4a6da1a2c73', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c251d69-ba86-4420-9bd7-87947fd44c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:09 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] Volume volume-cd113227-b478-48a7-be2b-e4a6da1a2c73 (cd113227-b478-48a7-be2b-e4a6da1a2c73): created successfully Apr 10 10:39:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c251d69-ba86-4420-9bd7-87947fd44c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] Flow 'volume_create_manager' (5d891084-87f9-42a3-a960-e89196c4b539) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:09 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-2c42ab6d-c32b-491f-903a-ff6debc56fd0 tempest-VolumeDependencyTests-1654235345 None] Created volume successfully. Apr 10 10:39:10 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Flow 'volume_create_manager' (e108a6f8-54d7-4062-ab5c-df3005d42302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (024a818b-e96c-4620-a394-23cfac48d19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (024a818b-e96c-4620-a394-23cfac48d19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-156967705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d90fe17-5e57-4f59-88d1-f9617530248a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e24e3640a244eba62916ade4e82102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=cd113227-b478-48a7-be2b-e4a6da1a2c73,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:11Z,use_quota=True,user_id='c1c452dfd2224da7b87d00a43db817a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f74d0987-503a-4692-8816-f19768ea3170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f74d0987-503a-4692-8816-f19768ea3170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49330f07-e978-4c3e-ab25-795f3dac28dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49330f07-e978-4c3e-ab25-795f3dac28dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3d90fe17-5e57-4f59-88d1-f9617530248a', 'volume_name': 'volume-3d90fe17-5e57-4f59-88d1-f9617530248a', 'volume_size': 1, 'source_volid': 'cd113227-b478-48a7-be2b-e4a6da1a2c73', 'source_volstatus': 'available'}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1438d07c-8389-4472-a058-94bfa5184e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1438d07c-8389-4472-a058-94bfa5184e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60b6c777-4f54-4405-99cc-23e47b0a1af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:10 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Volume 3d90fe17-5e57-4f59-88d1-f9617530248a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3d90fe17-5e57-4f59-88d1-f9617530248a', 'volume_size': 1, 'source_volid': 'cd113227-b478-48a7-be2b-e4a6da1a2c73', 'source_volstatus': 'available'} Apr 10 10:39:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:10 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Cloning volume cd113227-b478-48a7-be2b-e4a6da1a2c73 to volume 3d90fe17-5e57-4f59-88d1-f9617530248a Apr 10 10:39:10 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Flow 'volume_create_manager' (0817bbe7-1822-46e5-81da-c50daafb624c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35e72404-9fde-4b8e-aa54-8587b35f7a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35e72404-9fde-4b8e-aa54-8587b35f7a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1247748902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=decea743-16f9-4b1e-b437-c426bead3036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9217829cde04e6d8a1eafcb3d2c82fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:11Z,use_quota=True,user_id='01af411d256748dbb2c86b468a613099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d9219a6-5394-454a-829b-7caf5dc524b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d9219a6-5394-454a-829b-7caf5dc524b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a85493f-f371-45bd-bd1b-4ace504d72af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a85493f-f371-45bd-bd1b-4ace504d72af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'decea743-16f9-4b1e-b437-c426bead3036', 'volume_name': 'volume-decea743-16f9-4b1e-b437-c426bead3036', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b27a72b4-a34f-4ffa-a3f2-215a7441286e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b27a72b4-a34f-4ffa-a3f2-215a7441286e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:10 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f8d8388-c475-481a-9d08-0cbf14ac2270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:10 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Volume decea743-16f9-4b1e-b437-c426bead3036: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-decea743-16f9-4b1e-b437-c426bead3036', 'volume_size': 1} Apr 10 10:39:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:10 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Creating offline snapshot 363988fb-3821-42b2-a446-ee106dea8bc1 of volume cd113227-b478-48a7-be2b-e4a6da1a2c73 {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:39:10 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12a6830-a577-4768-83c9-7204c7031488]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:10 devstack sudo[88046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73 Apr 10 10:39:10 devstack sudo[88046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:11 devstack sudo[88046]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73" returned: 0 in 0.561s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73.363988fb-3821-42b2-a446-ee106dea8bc1 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:11 devstack sudo[88051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73.363988fb-3821-42b2-a446-ee106dea8bc1 1G Apr 10 10:39:11 devstack sudo[88051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:12 devstack sudo[88051]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73.363988fb-3821-42b2-a446-ee106dea8bc1 1G" returned: 0 in 0.710s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd113227-b478-48a7-be2b-e4a6da1a2c73 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73.363988fb-3821-42b2-a446-ee106dea8bc1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:12 devstack sudo[88057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd113227-b478-48a7-be2b-e4a6da1a2c73 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73.363988fb-3821-42b2-a446-ee106dea8bc1 Apr 10 10:39:12 devstack sudo[88057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:12 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:12 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] Flow 'volume_create_manager' (ce2eaa43-1dc9-4b42-832a-215541611452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:12 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f7dd1e-bfac-4135-a51a-d04eb2eb15eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:12 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f7dd1e-bfac-4135-a51a-d04eb2eb15eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-949610444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2096d6ec-9303-4ed9-a985-6f5bdcd5a202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa770f15210f4eabbda91dd1cd3eb2b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:12Z,use_quota=True,user_id='2b5d468127fe4700b9eed0ba7cc1c590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:12 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b1f317f-3c58-4937-920b-e28901e6f594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:12 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b1f317f-3c58-4937-920b-e28901e6f594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:12 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (405b7472-2732-46d1-98b2-7e5091653972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:12 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (405b7472-2732-46d1-98b2-7e5091653972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2096d6ec-9303-4ed9-a985-6f5bdcd5a202', 'volume_name': 'volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:12 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff261d8-4c99-42b1-bc91-7e213e9ed857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:12 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff261d8-4c99-42b1-bc91-7e213e9ed857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:12 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (445fd6dc-24cd-4937-bcd8-b3216be3ec7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:12 devstack sudo[88057]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:12 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] Volume 2096d6ec-9303-4ed9-a985-6f5bdcd5a202: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202', 'volume_size': 1} Apr 10 10:39:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd113227-b478-48a7-be2b-e4a6da1a2c73 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73.363988fb-3821-42b2-a446-ee106dea8bc1" returned: 0 in 0.511s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:12 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73.363988fb-3821-42b2-a446-ee106dea8bc1 is being set with open permissions: ugo+rw Apr 10 10:39:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73.363988fb-3821-42b2-a446-ee106dea8bc1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:12 devstack sudo[88062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73.363988fb-3821-42b2-a446-ee106dea8bc1 Apr 10 10:39:12 devstack sudo[88062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:13 devstack sudo[88062]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73.363988fb-3821-42b2-a446-ee106dea8bc1" returned: 0 in 0.447s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:13 devstack sudo[88065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73.info Apr 10 10:39:13 devstack sudo[88065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:13 devstack sudo[88065]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73.info" returned: 0 in 0.421s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:13 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73.info is being set with open permissions: ugo+rw Apr 10 10:39:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:13 devstack sudo[88068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73.info Apr 10 10:39:13 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:13 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73.info" returned: 0 in 0.425s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:13 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Acquiring lock "cinder-quobyte-3d90fe17-5e57-4f59-88d1-f9617530248a" by "_copy_volume_from_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:13 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Lock "cinder-quobyte-3d90fe17-5e57-4f59-88d1-f9617530248a" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:13 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] snapshot: 363988fb-3821-42b2-a446-ee106dea8bc1, volume: 3d90fe17-5e57-4f59-88d1-f9617530248a, {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:39:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:13 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:13 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:13 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[778acd75-3405-4d0d-a004-cef750415b89]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73.363988fb-3821-42b2-a446-ee106dea8bc1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:14 devstack sudo[88071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73.363988fb-3821-42b2-a446-ee106dea8bc1 Apr 10 10:39:14 devstack sudo[88071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:14 devstack sudo[88071]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73.363988fb-3821-42b2-a446-ee106dea8bc1" returned: 0 in 0.484s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:14 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd113227-b478-48a7-be2b-e4a6da1a2c73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:39:14 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73 {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:39:14 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Creating direct copy from snapshot {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:39:14 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b61f9d-67db-4307-a290-d720e4c856da]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:14 devstack sudo[88076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73 Apr 10 10:39:14 devstack sudo[88076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:14 devstack sudo[88076]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73" returned: 0 in 0.513s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:14 devstack cinder-volume[81938]: DEBUG cinder.utils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Path /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3d90fe17-5e57-4f59-88d1-f9617530248a not found in is_blk_device check {{(pid=81938) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:39:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3d90fe17-5e57-4f59-88d1-f9617530248a {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:14 devstack sudo[88081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3d90fe17-5e57-4f59-88d1-f9617530248a Apr 10 10:39:14 devstack sudo[88081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:17 devstack sudo[88081]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3d90fe17-5e57-4f59-88d1-f9617530248a" returned: 0 in 2.055s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:17 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6ed412-a845-4fc4-b286-83455cf1a797]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:17 devstack sudo[88093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73 Apr 10 10:39:17 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:17 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73" returned: 0 in 0.602s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:17 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73, size 1024.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3d90fe17-5e57-4f59-88d1-f9617530248a {{(pid=81938) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:39:17 devstack cinder-volume[81938]: INFO cinder.image.image_utils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Converted 1024.00 MB image at 497.90 MB/s Apr 10 10:39:17 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3d90fe17-5e57-4f59-88d1-f9617530248a is being set with open permissions: ugo+rw Apr 10 10:39:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3d90fe17-5e57-4f59-88d1-f9617530248a {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:17 devstack sudo[88098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3d90fe17-5e57-4f59-88d1-f9617530248a Apr 10 10:39:17 devstack sudo[88098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:18 devstack sudo[88098]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3d90fe17-5e57-4f59-88d1-f9617530248a" returned: 0 in 0.443s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:18 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Lock "cinder-quobyte-3d90fe17-5e57-4f59-88d1-f9617530248a" released by "_copy_volume_from_snapshot" :: held 4.146s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:18 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Acquiring lock "cinder-quobyte-363988fb-3821-42b2-a446-ee106dea8bc1" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:18 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Lock "cinder-quobyte-363988fb-3821-42b2-a446-ee106dea8bc1" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:18 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Deleting offline snapshot 363988fb-3821-42b2-a446-ee106dea8bc1 of volume cd113227-b478-48a7-be2b-e4a6da1a2c73 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:39:18 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] snapshot_file for this snap is: volume-cd113227-b478-48a7-be2b-e4a6da1a2c73.363988fb-3821-42b2-a446-ee106dea8bc1 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:39:18 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[328e786d-deba-4138-8981-6039830a0047]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73.363988fb-3821-42b2-a446-ee106dea8bc1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:18 devstack sudo[88101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73.363988fb-3821-42b2-a446-ee106dea8bc1 Apr 10 10:39:18 devstack sudo[88101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:18 devstack sudo[88101]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73.363988fb-3821-42b2-a446-ee106dea8bc1" returned: 0 in 0.473s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:18 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd113227-b478-48a7-be2b-e4a6da1a2c73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:39:18 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[066eb6bf-2888-4c1f-8593-ae493deba535]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:18 devstack sudo[88106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73 Apr 10 10:39:18 devstack sudo[88106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:19 devstack sudo[88106]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73" returned: 0 in 0.501s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73.363988fb-3821-42b2-a446-ee106dea8bc1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:19 devstack sudo[88111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73.363988fb-3821-42b2-a446-ee106dea8bc1 Apr 10 10:39:19 devstack sudo[88111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:19 devstack sudo[88111]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73.363988fb-3821-42b2-a446-ee106dea8bc1" returned: 0 in 0.441s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73.363988fb-3821-42b2-a446-ee106dea8bc1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:19 devstack sudo[88116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73.363988fb-3821-42b2-a446-ee106dea8bc1 Apr 10 10:39:19 devstack sudo[88116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:19 devstack sudo[88116]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73.363988fb-3821-42b2-a446-ee106dea8bc1" returned: 0 in 0.436s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:19 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Lock "cinder-quobyte-363988fb-3821-42b2-a446-ee106dea8bc1" released by "_delete_snapshot" :: held 1.902s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:20 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writing DB stats cinder:SELECT=102,cinder:UPDATE=119,cinder:DELETE=6,cinder:INSERT=36 {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:39:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.315s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.239s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:20 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1247748902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=decea743-16f9-4b1e-b437-c426bead3036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9217829cde04e6d8a1eafcb3d2c82fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:11Z,use_quota=True,user_id='01af411d256748dbb2c86b468a613099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:39:20 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Creating volume decea743-16f9-4b1e-b437-c426bead3036 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:39:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:20 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:20 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:20 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:20 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:39:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decea743-16f9-4b1e-b437-c426bead3036 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60b6c777-4f54-4405-99cc-23e47b0a1af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d90fe17-5e57-4f59-88d1-f9617530248a', 'volume_size': 1, 'source_volid': 'cd113227-b478-48a7-be2b-e4a6da1a2c73', 'source_volstatus': 'available'}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75beb35b-938d-4035-b99e-38c57cff04c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:20 devstack sudo[88120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decea743-16f9-4b1e-b437-c426bead3036 1073741824 Apr 10 10:39:20 devstack sudo[88120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:20 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Volume volume-3d90fe17-5e57-4f59-88d1-f9617530248a (3d90fe17-5e57-4f59-88d1-f9617530248a): created successfully Apr 10 10:39:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75beb35b-938d-4035-b99e-38c57cff04c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Flow 'volume_create_manager' (e108a6f8-54d7-4062-ab5c-df3005d42302) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:20 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-c32573a5-30a0-4226-8d59-83e51f1fdc97 tempest-VolumeDependencyTests-1654235345 None] Created volume successfully. Apr 10 10:39:20 devstack sudo[88120]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decea743-16f9-4b1e-b437-c426bead3036 1073741824" returned: 0 in 0.544s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decea743-16f9-4b1e-b437-c426bead3036 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:20 devstack sudo[88125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decea743-16f9-4b1e-b437-c426bead3036 Apr 10 10:39:20 devstack sudo[88125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:21 devstack sudo[88125]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decea743-16f9-4b1e-b437-c426bead3036" returned: 0 in 0.432s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.453s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-949610444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2096d6ec-9303-4ed9-a985-6f5bdcd5a202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa770f15210f4eabbda91dd1cd3eb2b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:12Z,use_quota=True,user_id='2b5d468127fe4700b9eed0ba7cc1c590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] Creating volume 2096d6ec-9303-4ed9-a985-6f5bdcd5a202 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:21 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f8d8388-c475-481a-9d08-0cbf14ac2270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-decea743-16f9-4b1e-b437-c426bead3036', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f12f78-70fd-4492-9045-803d8a8e51b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:21 devstack sudo[88128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202 1073741824 Apr 10 10:39:21 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:21 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Volume volume-decea743-16f9-4b1e-b437-c426bead3036 (decea743-16f9-4b1e-b437-c426bead3036): created successfully Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f12f78-70fd-4492-9045-803d8a8e51b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Flow 'volume_create_manager' (0817bbe7-1822-46e5-81da-c50daafb624c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:21 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-7f22297f-17a7-45cd-9c0f-21310b4f5380 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Created volume successfully. Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7eabaaa2-772c-4843-92bf-d1926fd20b33 tempest-VolumeDependencyTests-1654235345 None] Acquiring lock "cinder-cd113227-b478-48a7-be2b-e4a6da1a2c73-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7eabaaa2-772c-4843-92bf-d1926fd20b33 tempest-VolumeDependencyTests-1654235345 None] Lock "cinder-cd113227-b478-48a7-be2b-e4a6da1a2c73-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7eabaaa2-772c-4843-92bf-d1926fd20b33 tempest-VolumeDependencyTests-1654235345 None] Acquiring lock "cinder-quobyte-cd113227-b478-48a7-be2b-e4a6da1a2c73" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7eabaaa2-772c-4843-92bf-d1926fd20b33 tempest-VolumeDependencyTests-1654235345 None] Lock "cinder-quobyte-cd113227-b478-48a7-be2b-e4a6da1a2c73" acquired by "delete_volume" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c4d25a-1ced-4dfe-b81c-ec1f126a0e9a]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7eabaaa2-772c-4843-92bf-d1926fd20b33 tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:21 devstack sudo[88130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73 Apr 10 10:39:21 devstack sudo[88130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Flow 'volume_create_manager' (fe3a65f0-b50b-4a6f-9866-c153f38fa891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e2691de-afc8-4a73-ada0-9da03f3eef2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e2691de-afc8-4a73-ada0-9da03f3eef2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-759804132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c0a232-c02f-4f0a-abc0-67eeaf9464df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9217829cde04e6d8a1eafcb3d2c82fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:21Z,use_quota=True,user_id='01af411d256748dbb2c86b468a613099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3d0d9d0-85d3-46bc-863a-e9f011f0e09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3d0d9d0-85d3-46bc-863a-e9f011f0e09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (444027c4-7f65-4d46-a8bc-5a60a592e392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (444027c4-7f65-4d46-a8bc-5a60a592e392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05c0a232-c02f-4f0a-abc0-67eeaf9464df', 'volume_name': 'volume-05c0a232-c02f-4f0a-abc0-67eeaf9464df', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d208c83-0c80-4103-b5f5-0d5d736a971b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d208c83-0c80-4103-b5f5-0d5d736a971b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff1443d2-510f-4c53-bf26-be1013b673e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:21 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Volume 05c0a232-c02f-4f0a-abc0-67eeaf9464df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05c0a232-c02f-4f0a-abc0-67eeaf9464df', 'volume_size': 1} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:21 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202 1073741824" returned: 0 in 0.646s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:21 devstack sudo[88135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202 Apr 10 10:39:21 devstack sudo[88135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Flow 'volume_create_manager' (1b9ab513-126f-49db-82a1-cefb1489d0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e48169-a579-48bb-919d-eb21fbc7efc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e48169-a579-48bb-919d-eb21fbc7efc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1112520113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78f2898b-24e8-4cce-87da-d362b36a1829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9217829cde04e6d8a1eafcb3d2c82fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:22Z,use_quota=True,user_id='01af411d256748dbb2c86b468a613099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c68936-2954-4127-a8b3-c343a070049e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c68936-2954-4127-a8b3-c343a070049e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac4ec73-fcfe-4809-b5b2-546e3ab417f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac4ec73-fcfe-4809-b5b2-546e3ab417f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78f2898b-24e8-4cce-87da-d362b36a1829', 'volume_name': 'volume-78f2898b-24e8-4cce-87da-d362b36a1829', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (470a3b87-a902-4198-bed7-2fe5cba4948b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (470a3b87-a902-4198-bed7-2fe5cba4948b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05efd62f-5494-48d8-9bac-3ec5e7bf40be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:21 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Volume 78f2898b-24e8-4cce-87da-d362b36a1829: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78f2898b-24e8-4cce-87da-d362b36a1829', 'volume_size': 1} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:21 devstack sudo[88130]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7eabaaa2-772c-4843-92bf-d1926fd20b33 tempest-VolumeDependencyTests-1654235345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73" returned: 0 in 0.679s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7eabaaa2-772c-4843-92bf-d1926fd20b33 tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:21 devstack sudo[88140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73 Apr 10 10:39:21 devstack sudo[88140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Flow 'volume_create_manager' (c86ac539-8897-4b04-88c8-78393521d54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8130aa7-d073-492c-b657-48f9e4d3bb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8130aa7-d073-492c-b657-48f9e4d3bb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-396013485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b685d5d-1d74-4b8c-a58c-a306196ad2d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9217829cde04e6d8a1eafcb3d2c82fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:22Z,use_quota=True,user_id='01af411d256748dbb2c86b468a613099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (205bfba6-95dd-4b43-8b3b-2f17d9c9efe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (205bfba6-95dd-4b43-8b3b-2f17d9c9efe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (301f9eab-a4e3-43fd-839e-2c7c16f9850b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (301f9eab-a4e3-43fd-839e-2c7c16f9850b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b685d5d-1d74-4b8c-a58c-a306196ad2d9', 'volume_name': 'volume-1b685d5d-1d74-4b8c-a58c-a306196ad2d9', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b80067-31cb-47ad-97d1-98dcb6d1fdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b80067-31cb-47ad-97d1-98dcb6d1fdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d51314-9729-4845-ac3f-a5c7be060250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:22 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Volume 1b685d5d-1d74-4b8c-a58c-a306196ad2d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b685d5d-1d74-4b8c-a58c-a306196ad2d9', 'volume_size': 1} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:22 devstack sudo[88135]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202" returned: 0 in 0.529s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.673s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-759804132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c0a232-c02f-4f0a-abc0-67eeaf9464df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9217829cde04e6d8a1eafcb3d2c82fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:21Z,use_quota=True,user_id='01af411d256748dbb2c86b468a613099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Creating volume 05c0a232-c02f-4f0a-abc0-67eeaf9464df {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:22 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-05c0a232-c02f-4f0a-abc0-67eeaf9464df 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (445fd6dc-24cd-4937-bcd8-b3216be3ec7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e80d86e-c09f-4919-adac-a0725d3ad494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:22 devstack sudo[88143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-05c0a232-c02f-4f0a-abc0-67eeaf9464df 1073741824 Apr 10 10:39:22 devstack sudo[88143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:22 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] Volume volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202 (2096d6ec-9303-4ed9-a985-6f5bdcd5a202): created successfully Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e80d86e-c09f-4919-adac-a0725d3ad494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] Flow 'volume_create_manager' (ce2eaa43-1dc9-4b42-832a-215541611452) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:22 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-95f8144f-edca-438c-8192-891139ebf750 tempest-VolumesSnapshotTestJSON-425060456 None] Created volume successfully. Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Flow 'volume_create_manager' (3e117e25-9e3c-4543-8008-5e98a72e7fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74dccba0-dbab-42bf-86e3-da56c390fc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74dccba0-dbab-42bf-86e3-da56c390fc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-547443861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b291b36c-8e29-4b4c-993d-47aa11950fc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9217829cde04e6d8a1eafcb3d2c82fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:22Z,use_quota=True,user_id='01af411d256748dbb2c86b468a613099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99c12724-2228-43de-b3b0-516a53397d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99c12724-2228-43de-b3b0-516a53397d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b5b298-a0b2-4204-acdc-9c8db9cef7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b5b298-a0b2-4204-acdc-9c8db9cef7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b291b36c-8e29-4b4c-993d-47aa11950fc9', 'volume_name': 'volume-b291b36c-8e29-4b4c-993d-47aa11950fc9', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da103825-7f88-4b34-ba8c-ae15b1d7f453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da103825-7f88-4b34-ba8c-ae15b1d7f453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (392dc531-e69f-4cd7-aee6-664bc99631be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:22 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Volume b291b36c-8e29-4b4c-993d-47aa11950fc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b291b36c-8e29-4b4c-993d-47aa11950fc9', 'volume_size': 1} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:22 devstack sudo[88140]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7eabaaa2-772c-4843-92bf-d1926fd20b33 tempest-VolumeDependencyTests-1654235345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cd113227-b478-48a7-be2b-e4a6da1a2c73" returned: 0 in 0.586s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7eabaaa2-772c-4843-92bf-d1926fd20b33 tempest-VolumeDependencyTests-1654235345 None] Lock "cinder-quobyte-cd113227-b478-48a7-be2b-e4a6da1a2c73" released by "delete_volume" :: held 1.298s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Flow 'volume_create_manager' (e4e64dd8-c40a-4119-83ee-dee0df6cbebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251d9154-1cec-4475-8e24-84bbd7c21277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251d9154-1cec-4475-8e24-84bbd7c21277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-515983754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c82a32f-ce0c-4e9b-a5b7-51c704fd47a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9217829cde04e6d8a1eafcb3d2c82fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:23Z,use_quota=True,user_id='01af411d256748dbb2c86b468a613099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19dd2af-706c-414e-92c6-039207e6e537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19dd2af-706c-414e-92c6-039207e6e537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7116ce9-bbf5-42f4-b6bc-a911733783f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7116ce9-bbf5-42f4-b6bc-a911733783f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c82a32f-ce0c-4e9b-a5b7-51c704fd47a3', 'volume_name': 'volume-4c82a32f-ce0c-4e9b-a5b7-51c704fd47a3', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f0a257f-f96d-401f-b718-7f2c52f599d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f0a257f-f96d-401f-b718-7f2c52f599d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9bd75d7-c88a-4a20-932d-a49fba450a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:22 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Volume 4c82a32f-ce0c-4e9b-a5b7-51c704fd47a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c82a32f-ce0c-4e9b-a5b7-51c704fd47a3', 'volume_size': 1} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-7eabaaa2-772c-4843-92bf-d1926fd20b33 tempest-VolumeDependencyTests-1654235345 None] Created reservations ['01a8df2d-eeb6-4367-b473-6af89fbc5efe', '67c12dc8-7fac-41a8-9a5a-d0a2b664680b', 'a6317850-d0c4-43a6-8313-a6a55217d0ca', '35f9ed35-ffb0-4d34-a2a8-3c92da8040ae'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7eabaaa2-772c-4843-92bf-d1926fd20b33 tempest-VolumeDependencyTests-1654235345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7eabaaa2-772c-4843-92bf-d1926fd20b33 tempest-VolumeDependencyTests-1654235345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7eabaaa2-772c-4843-92bf-d1926fd20b33 tempest-VolumeDependencyTests-1654235345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7eabaaa2-772c-4843-92bf-d1926fd20b33 tempest-VolumeDependencyTests-1654235345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7eabaaa2-772c-4843-92bf-d1926fd20b33 tempest-VolumeDependencyTests-1654235345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7eabaaa2-772c-4843-92bf-d1926fd20b33 tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:22 devstack sudo[88146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:39:22 devstack sudo[88146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:22 devstack sudo[88143]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-05c0a232-c02f-4f0a-abc0-67eeaf9464df 1073741824" returned: 0 in 0.589s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-05c0a232-c02f-4f0a-abc0-67eeaf9464df {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:22 devstack sudo[88151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-05c0a232-c02f-4f0a-abc0-67eeaf9464df Apr 10 10:39:22 devstack sudo[88151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:23 devstack sudo[88146]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7eabaaa2-772c-4843-92bf-d1926fd20b33 tempest-VolumeDependencyTests-1654235345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.477s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:23 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-7eabaaa2-772c-4843-92bf-d1926fd20b33 tempest-VolumeDependencyTests-1654235345 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:23 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-7eabaaa2-772c-4843-92bf-d1926fd20b33 tempest-VolumeDependencyTests-1654235345 None] Deleted volume successfully. Apr 10 10:39:23 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7eabaaa2-772c-4843-92bf-d1926fd20b33 tempest-VolumeDependencyTests-1654235345 None] Lock "cinder-cd113227-b478-48a7-be2b-e4a6da1a2c73-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-620fc2bf-155d-4eb7-8e81-fdc15b487834 tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:23 devstack sudo[88151]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-05c0a232-c02f-4f0a-abc0-67eeaf9464df" returned: 0 in 0.480s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:23 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:39:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.470s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:23 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1112520113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78f2898b-24e8-4cce-87da-d362b36a1829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9217829cde04e6d8a1eafcb3d2c82fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:22Z,use_quota=True,user_id='01af411d256748dbb2c86b468a613099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:39:23 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Creating volume 78f2898b-24e8-4cce-87da-d362b36a1829 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:39:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:23 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:23 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:23 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:23 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:39:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-78f2898b-24e8-4cce-87da-d362b36a1829 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:23 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff1443d2-510f-4c53-bf26-be1013b673e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05c0a232-c02f-4f0a-abc0-67eeaf9464df', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:23 devstack sudo[88155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-78f2898b-24e8-4cce-87da-d362b36a1829 1073741824 Apr 10 10:39:23 devstack sudo[88155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:23 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6db5f516-8167-4857-8a38-28a3759c2841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:23 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Volume volume-05c0a232-c02f-4f0a-abc0-67eeaf9464df (05c0a232-c02f-4f0a-abc0-67eeaf9464df): created successfully Apr 10 10:39:23 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6db5f516-8167-4857-8a38-28a3759c2841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:23 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Flow 'volume_create_manager' (fe3a65f0-b50b-4a6f-9866-c153f38fa891) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:23 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-44fba836-69a4-49c1-8e5e-9cdcf38bc53d tempest-VolumeDependencyTests-1654235345 None] Acquiring lock "cinder-3d90fe17-5e57-4f59-88d1-f9617530248a-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:23 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-e15f46e3-1cdb-41dc-b054-fde50dd0448d tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Created volume successfully. Apr 10 10:39:23 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-44fba836-69a4-49c1-8e5e-9cdcf38bc53d tempest-VolumeDependencyTests-1654235345 None] Lock "cinder-3d90fe17-5e57-4f59-88d1-f9617530248a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:23 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-44fba836-69a4-49c1-8e5e-9cdcf38bc53d tempest-VolumeDependencyTests-1654235345 None] Acquiring lock "cinder-quobyte-3d90fe17-5e57-4f59-88d1-f9617530248a" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:23 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-44fba836-69a4-49c1-8e5e-9cdcf38bc53d tempest-VolumeDependencyTests-1654235345 None] Lock "cinder-quobyte-3d90fe17-5e57-4f59-88d1-f9617530248a" acquired by "delete_volume" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:23 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cd2cc6-fb6e-4720-82f6-7115f24ffeee]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-44fba836-69a4-49c1-8e5e-9cdcf38bc53d tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3d90fe17-5e57-4f59-88d1-f9617530248a {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:23 devstack sudo[88157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3d90fe17-5e57-4f59-88d1-f9617530248a Apr 10 10:39:23 devstack sudo[88157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:23 devstack sudo[88155]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-78f2898b-24e8-4cce-87da-d362b36a1829 1073741824" returned: 0 in 0.507s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-78f2898b-24e8-4cce-87da-d362b36a1829 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:23 devstack sudo[88165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-78f2898b-24e8-4cce-87da-d362b36a1829 Apr 10 10:39:23 devstack sudo[88165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:23 devstack sudo[88157]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-44fba836-69a4-49c1-8e5e-9cdcf38bc53d tempest-VolumeDependencyTests-1654235345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3d90fe17-5e57-4f59-88d1-f9617530248a" returned: 0 in 0.509s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-44fba836-69a4-49c1-8e5e-9cdcf38bc53d tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3d90fe17-5e57-4f59-88d1-f9617530248a {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:24 devstack sudo[88167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3d90fe17-5e57-4f59-88d1-f9617530248a Apr 10 10:39:24 devstack sudo[88167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:24 devstack sudo[88165]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-78f2898b-24e8-4cce-87da-d362b36a1829" returned: 0 in 0.416s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.245s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-396013485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b685d5d-1d74-4b8c-a58c-a306196ad2d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9217829cde04e6d8a1eafcb3d2c82fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:22Z,use_quota=True,user_id='01af411d256748dbb2c86b468a613099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Creating volume 1b685d5d-1d74-4b8c-a58c-a306196ad2d9 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:24 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1b685d5d-1d74-4b8c-a58c-a306196ad2d9 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05efd62f-5494-48d8-9bac-3ec5e7bf40be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78f2898b-24e8-4cce-87da-d362b36a1829', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7144aa94-135a-475d-a19d-73fdddf10c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:24 devstack sudo[88171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1b685d5d-1d74-4b8c-a58c-a306196ad2d9 1073741824 Apr 10 10:39:24 devstack sudo[88171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:24 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Volume volume-78f2898b-24e8-4cce-87da-d362b36a1829 (78f2898b-24e8-4cce-87da-d362b36a1829): created successfully Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7144aa94-135a-475d-a19d-73fdddf10c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Flow 'volume_create_manager' (1b9ab513-126f-49db-82a1-cefb1489d0b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:24 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-05ffb7bf-5e8a-4324-bafe-cd63aae7256f tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Created volume successfully. Apr 10 10:39:24 devstack sudo[88167]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-44fba836-69a4-49c1-8e5e-9cdcf38bc53d tempest-VolumeDependencyTests-1654235345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-3d90fe17-5e57-4f59-88d1-f9617530248a" returned: 0 in 0.418s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-44fba836-69a4-49c1-8e5e-9cdcf38bc53d tempest-VolumeDependencyTests-1654235345 None] Lock "cinder-quobyte-3d90fe17-5e57-4f59-88d1-f9617530248a" released by "delete_volume" :: held 0.947s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-44fba836-69a4-49c1-8e5e-9cdcf38bc53d tempest-VolumeDependencyTests-1654235345 None] Created reservations ['6dae9774-0773-45c1-b5ed-d0361ff06dce', '6a6404e1-f7a7-4651-87dd-03690299223f', 'ec692a27-d3cf-4919-955a-73a31cec7e5e', '51a117aa-d12c-4062-827f-0c8280fc16db'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-44fba836-69a4-49c1-8e5e-9cdcf38bc53d tempest-VolumeDependencyTests-1654235345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-44fba836-69a4-49c1-8e5e-9cdcf38bc53d tempest-VolumeDependencyTests-1654235345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-44fba836-69a4-49c1-8e5e-9cdcf38bc53d tempest-VolumeDependencyTests-1654235345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-44fba836-69a4-49c1-8e5e-9cdcf38bc53d tempest-VolumeDependencyTests-1654235345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-44fba836-69a4-49c1-8e5e-9cdcf38bc53d tempest-VolumeDependencyTests-1654235345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-44fba836-69a4-49c1-8e5e-9cdcf38bc53d tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:24 devstack sudo[88173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:39:24 devstack sudo[88173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7d1cf412-d20b-4aca-88df-534075342c1c tempest-VolumeDependencyTests-1654235345 None] Acquiring lock "cinder-f6b295f0-f306-4ba2-aac5-b5bfd756432c-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7d1cf412-d20b-4aca-88df-534075342c1c tempest-VolumeDependencyTests-1654235345 None] Lock "cinder-f6b295f0-f306-4ba2-aac5-b5bfd756432c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7d1cf412-d20b-4aca-88df-534075342c1c tempest-VolumeDependencyTests-1654235345 None] Acquiring lock "cinder-quobyte-f6b295f0-f306-4ba2-aac5-b5bfd756432c" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7d1cf412-d20b-4aca-88df-534075342c1c tempest-VolumeDependencyTests-1654235345 None] Lock "cinder-quobyte-f6b295f0-f306-4ba2-aac5-b5bfd756432c" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[679bfeab-7585-4706-b58f-dbdec25b3e1e]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7d1cf412-d20b-4aca-88df-534075342c1c tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f6b295f0-f306-4ba2-aac5-b5bfd756432c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:24 devstack sudo[88175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f6b295f0-f306-4ba2-aac5-b5bfd756432c Apr 10 10:39:24 devstack sudo[88175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:24 devstack sudo[88171]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1b685d5d-1d74-4b8c-a58c-a306196ad2d9 1073741824" returned: 0 in 0.602s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:24 devstack sudo[88173]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-44fba836-69a4-49c1-8e5e-9cdcf38bc53d tempest-VolumeDependencyTests-1654235345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.470s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-44fba836-69a4-49c1-8e5e-9cdcf38bc53d tempest-VolumeDependencyTests-1654235345 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:24 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-44fba836-69a4-49c1-8e5e-9cdcf38bc53d tempest-VolumeDependencyTests-1654235345 None] Deleted volume successfully. Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1b685d5d-1d74-4b8c-a58c-a306196ad2d9 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:24 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-44fba836-69a4-49c1-8e5e-9cdcf38bc53d tempest-VolumeDependencyTests-1654235345 None] Lock "cinder-3d90fe17-5e57-4f59-88d1-f9617530248a-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:24 devstack sudo[88181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1b685d5d-1d74-4b8c-a58c-a306196ad2d9 Apr 10 10:39:24 devstack sudo[88181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:25 devstack sudo[88175]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7d1cf412-d20b-4aca-88df-534075342c1c tempest-VolumeDependencyTests-1654235345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f6b295f0-f306-4ba2-aac5-b5bfd756432c" returned: 0 in 0.549s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7d1cf412-d20b-4aca-88df-534075342c1c tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f6b295f0-f306-4ba2-aac5-b5bfd756432c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:25 devstack sudo[88186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f6b295f0-f306-4ba2-aac5-b5bfd756432c Apr 10 10:39:25 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:25 devstack sudo[88181]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1b685d5d-1d74-4b8c-a58c-a306196ad2d9" returned: 0 in 0.425s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:39:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.998s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-547443861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b291b36c-8e29-4b4c-993d-47aa11950fc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9217829cde04e6d8a1eafcb3d2c82fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:22Z,use_quota=True,user_id='01af411d256748dbb2c86b468a613099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:39:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Creating volume b291b36c-8e29-4b4c-993d-47aa11950fc9 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:39:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:25 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:39:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b291b36c-8e29-4b4c-993d-47aa11950fc9 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d51314-9729-4845-ac3f-a5c7be060250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b685d5d-1d74-4b8c-a58c-a306196ad2d9', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:25 devstack sudo[88189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b291b36c-8e29-4b4c-993d-47aa11950fc9 1073741824 Apr 10 10:39:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a27f9d41-8aa8-4c84-a4ae-618fc903c669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:25 devstack sudo[88189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:25 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Volume volume-1b685d5d-1d74-4b8c-a58c-a306196ad2d9 (1b685d5d-1d74-4b8c-a58c-a306196ad2d9): created successfully Apr 10 10:39:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a27f9d41-8aa8-4c84-a4ae-618fc903c669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Flow 'volume_create_manager' (c86ac539-8897-4b04-88c8-78393521d54e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:25 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-2ab994ea-19f6-48e8-a8eb-cdaeae670b07 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Created volume successfully. Apr 10 10:39:25 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7d1cf412-d20b-4aca-88df-534075342c1c tempest-VolumeDependencyTests-1654235345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f6b295f0-f306-4ba2-aac5-b5bfd756432c" returned: 0 in 0.414s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7d1cf412-d20b-4aca-88df-534075342c1c tempest-VolumeDependencyTests-1654235345 None] Lock "cinder-quobyte-f6b295f0-f306-4ba2-aac5-b5bfd756432c" released by "delete_volume" :: held 0.994s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:25 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-7d1cf412-d20b-4aca-88df-534075342c1c tempest-VolumeDependencyTests-1654235345 None] Created reservations ['44d42da2-1b66-4f85-86e4-4efcb0dd16c9', '4862d4e1-0a3a-41f6-9935-fce31b29cd96', '062076bb-7d1c-4b5e-a3b6-6f4c5251f962', 'ea7d7463-d178-40bd-8b94-4947e31c3e28'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7d1cf412-d20b-4aca-88df-534075342c1c tempest-VolumeDependencyTests-1654235345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7d1cf412-d20b-4aca-88df-534075342c1c tempest-VolumeDependencyTests-1654235345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7d1cf412-d20b-4aca-88df-534075342c1c tempest-VolumeDependencyTests-1654235345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7d1cf412-d20b-4aca-88df-534075342c1c tempest-VolumeDependencyTests-1654235345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7d1cf412-d20b-4aca-88df-534075342c1c tempest-VolumeDependencyTests-1654235345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7d1cf412-d20b-4aca-88df-534075342c1c tempest-VolumeDependencyTests-1654235345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:25 devstack sudo[88192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:39:25 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:25 devstack sudo[88189]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b291b36c-8e29-4b4c-993d-47aa11950fc9 1073741824" returned: 0 in 0.575s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b291b36c-8e29-4b4c-993d-47aa11950fc9 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:26 devstack sudo[88197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b291b36c-8e29-4b4c-993d-47aa11950fc9 Apr 10 10:39:26 devstack sudo[88197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:26 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7d1cf412-d20b-4aca-88df-534075342c1c tempest-VolumeDependencyTests-1654235345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.448s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:26 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-7d1cf412-d20b-4aca-88df-534075342c1c tempest-VolumeDependencyTests-1654235345 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:26 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-7d1cf412-d20b-4aca-88df-534075342c1c tempest-VolumeDependencyTests-1654235345 None] Deleted volume successfully. Apr 10 10:39:26 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7d1cf412-d20b-4aca-88df-534075342c1c tempest-VolumeDependencyTests-1654235345 None] Lock "cinder-f6b295f0-f306-4ba2-aac5-b5bfd756432c-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:26 devstack sudo[88197]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b291b36c-8e29-4b4c-993d-47aa11950fc9" returned: 0 in 0.424s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:26 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:39:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.823s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:26 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-515983754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c82a32f-ce0c-4e9b-a5b7-51c704fd47a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9217829cde04e6d8a1eafcb3d2c82fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:23Z,use_quota=True,user_id='01af411d256748dbb2c86b468a613099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:39:26 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Creating volume 4c82a32f-ce0c-4e9b-a5b7-51c704fd47a3 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:39:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:26 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:26 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:26 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:26 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:39:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4c82a32f-ce0c-4e9b-a5b7-51c704fd47a3 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:26 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (392dc531-e69f-4cd7-aee6-664bc99631be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b291b36c-8e29-4b4c-993d-47aa11950fc9', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:26 devstack sudo[88201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4c82a32f-ce0c-4e9b-a5b7-51c704fd47a3 1073741824 Apr 10 10:39:26 devstack sudo[88201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:26 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7336f24e-1798-4bfd-9056-0a5df045a219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:26 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Volume volume-b291b36c-8e29-4b4c-993d-47aa11950fc9 (b291b36c-8e29-4b4c-993d-47aa11950fc9): created successfully Apr 10 10:39:26 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7336f24e-1798-4bfd-9056-0a5df045a219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:26 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Flow 'volume_create_manager' (3e117e25-9e3c-4543-8008-5e98a72e7fa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:26 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-06a42e91-e733-4595-b360-b1ac9f9a21e3 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Created volume successfully. Apr 10 10:39:27 devstack sudo[88201]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4c82a32f-ce0c-4e9b-a5b7-51c704fd47a3 1073741824" returned: 0 in 0.571s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4c82a32f-ce0c-4e9b-a5b7-51c704fd47a3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:27 devstack sudo[88206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4c82a32f-ce0c-4e9b-a5b7-51c704fd47a3 Apr 10 10:39:27 devstack sudo[88206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:27 devstack sudo[88206]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4c82a32f-ce0c-4e9b-a5b7-51c704fd47a3" returned: 0 in 0.516s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:27 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:39:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-620fc2bf-155d-4eb7-8e81-fdc15b487834 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.255s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9bd75d7-c88a-4a20-932d-a49fba450a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c82a32f-ce0c-4e9b-a5b7-51c704fd47a3', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d06f61e9-a4d8-4c9f-9813-7646138bafdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:27 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-620fc2bf-155d-4eb7-8e81-fdc15b487834 tempest-VolumesSnapshotTestJSON-425060456 None] Creating offline snapshot 83ebd788-f1db-4c23-ac96-253733d36471 of volume 2096d6ec-9303-4ed9-a985-6f5bdcd5a202 {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:39:27 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Volume volume-4c82a32f-ce0c-4e9b-a5b7-51c704fd47a3 (4c82a32f-ce0c-4e9b-a5b7-51c704fd47a3): created successfully Apr 10 10:39:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d06f61e9-a4d8-4c9f-9813-7646138bafdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Flow 'volume_create_manager' (e4e64dd8-c40a-4119-83ee-dee0df6cbebd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:27 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c23889b-1125-41ec-bd19-7fe3fb487859]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-620fc2bf-155d-4eb7-8e81-fdc15b487834 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:27 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-a1a2923a-4c9c-4ea3-882d-f060fc871569 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Created volume successfully. Apr 10 10:39:27 devstack sudo[88209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202 Apr 10 10:39:27 devstack sudo[88209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:28 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-1d698279-6584-471c-84f4-817d1b3b56a9 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Acquiring lock "cinder-4c82a32f-ce0c-4e9b-a5b7-51c704fd47a3-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:28 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-1d698279-6584-471c-84f4-817d1b3b56a9 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "cinder-4c82a32f-ce0c-4e9b-a5b7-51c704fd47a3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:28 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-1d698279-6584-471c-84f4-817d1b3b56a9 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Acquiring lock "cinder-quobyte-4c82a32f-ce0c-4e9b-a5b7-51c704fd47a3" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:28 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-1d698279-6584-471c-84f4-817d1b3b56a9 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "cinder-quobyte-4c82a32f-ce0c-4e9b-a5b7-51c704fd47a3" acquired by "delete_volume" :: waited 0.012s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:28 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c17de50-eaef-434a-956c-bd5bf0f1aeff]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1d698279-6584-471c-84f4-817d1b3b56a9 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4c82a32f-ce0c-4e9b-a5b7-51c704fd47a3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:28 devstack sudo[88215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4c82a32f-ce0c-4e9b-a5b7-51c704fd47a3 Apr 10 10:39:28 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:28 devstack sudo[88209]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-620fc2bf-155d-4eb7-8e81-fdc15b487834 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202" returned: 0 in 0.645s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-620fc2bf-155d-4eb7-8e81-fdc15b487834 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202.83ebd788-f1db-4c23-ac96-253733d36471 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:28 devstack sudo[88217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202.83ebd788-f1db-4c23-ac96-253733d36471 1G Apr 10 10:39:28 devstack sudo[88217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:28 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1d698279-6584-471c-84f4-817d1b3b56a9 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4c82a32f-ce0c-4e9b-a5b7-51c704fd47a3" returned: 0 in 0.560s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1d698279-6584-471c-84f4-817d1b3b56a9 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4c82a32f-ce0c-4e9b-a5b7-51c704fd47a3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:28 devstack sudo[88225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4c82a32f-ce0c-4e9b-a5b7-51c704fd47a3 Apr 10 10:39:28 devstack sudo[88225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:28 devstack sudo[88217]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-620fc2bf-155d-4eb7-8e81-fdc15b487834 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202.83ebd788-f1db-4c23-ac96-253733d36471 1G" returned: 0 in 0.514s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-620fc2bf-155d-4eb7-8e81-fdc15b487834 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202.83ebd788-f1db-4c23-ac96-253733d36471 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:28 devstack sudo[88227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202.83ebd788-f1db-4c23-ac96-253733d36471 Apr 10 10:39:28 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:29 devstack sudo[88225]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1d698279-6584-471c-84f4-817d1b3b56a9 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-4c82a32f-ce0c-4e9b-a5b7-51c704fd47a3" returned: 0 in 0.441s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:29 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-1d698279-6584-471c-84f4-817d1b3b56a9 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "cinder-quobyte-4c82a32f-ce0c-4e9b-a5b7-51c704fd47a3" released by "delete_volume" :: held 1.030s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:29 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-1d698279-6584-471c-84f4-817d1b3b56a9 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Created reservations ['72fbb3fb-5ddf-4802-a7c5-e59665cfff39', '1053468e-0c4f-4e75-9c97-13b37e342adb', 'b7b56032-0847-4494-9543-e8824f3c0558', '1931a717-27f6-494f-aeb4-b2619b4145df'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1d698279-6584-471c-84f4-817d1b3b56a9 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1d698279-6584-471c-84f4-817d1b3b56a9 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:29 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1d698279-6584-471c-84f4-817d1b3b56a9 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:29 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1d698279-6584-471c-84f4-817d1b3b56a9 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1d698279-6584-471c-84f4-817d1b3b56a9 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1d698279-6584-471c-84f4-817d1b3b56a9 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:29 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-620fc2bf-155d-4eb7-8e81-fdc15b487834 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202.83ebd788-f1db-4c23-ac96-253733d36471" returned: 0 in 0.527s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:29 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-620fc2bf-155d-4eb7-8e81-fdc15b487834 tempest-VolumesSnapshotTestJSON-425060456 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202.83ebd788-f1db-4c23-ac96-253733d36471 is being set with open permissions: ugo+rw Apr 10 10:39:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-620fc2bf-155d-4eb7-8e81-fdc15b487834 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202.83ebd788-f1db-4c23-ac96-253733d36471 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:29 devstack sudo[88233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:39:29 devstack sudo[88233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:29 devstack sudo[88235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202.83ebd788-f1db-4c23-ac96-253733d36471 Apr 10 10:39:29 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:29 devstack sudo[88233]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1d698279-6584-471c-84f4-817d1b3b56a9 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.441s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:29 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-1d698279-6584-471c-84f4-817d1b3b56a9 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:29 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-1d698279-6584-471c-84f4-817d1b3b56a9 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Deleted volume successfully. Apr 10 10:39:29 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-1d698279-6584-471c-84f4-817d1b3b56a9 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "cinder-4c82a32f-ce0c-4e9b-a5b7-51c704fd47a3-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:29 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-620fc2bf-155d-4eb7-8e81-fdc15b487834 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202.83ebd788-f1db-4c23-ac96-253733d36471" returned: 0 in 0.458s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-620fc2bf-155d-4eb7-8e81-fdc15b487834 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:29 devstack sudo[88239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202.info Apr 10 10:39:29 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:30 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-620fc2bf-155d-4eb7-8e81-fdc15b487834 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202.info" returned: 0 in 0.437s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:30 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-620fc2bf-155d-4eb7-8e81-fdc15b487834 tempest-VolumesSnapshotTestJSON-425060456 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202.info is being set with open permissions: ugo+rw Apr 10 10:39:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-620fc2bf-155d-4eb7-8e81-fdc15b487834 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:30 devstack sudo[88243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202.info Apr 10 10:39:30 devstack sudo[88243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:30 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-76ac885a-a563-4c96-b015-a7e57c37cc0a tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Acquiring lock "cinder-b291b36c-8e29-4b4c-993d-47aa11950fc9-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:30 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-76ac885a-a563-4c96-b015-a7e57c37cc0a tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "cinder-b291b36c-8e29-4b4c-993d-47aa11950fc9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:30 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-76ac885a-a563-4c96-b015-a7e57c37cc0a tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Acquiring lock "cinder-quobyte-b291b36c-8e29-4b4c-993d-47aa11950fc9" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:30 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-76ac885a-a563-4c96-b015-a7e57c37cc0a tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "cinder-quobyte-b291b36c-8e29-4b4c-993d-47aa11950fc9" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:30 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec963200-9cf3-4c34-a028-0e7227270240]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-76ac885a-a563-4c96-b015-a7e57c37cc0a tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b291b36c-8e29-4b4c-993d-47aa11950fc9 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:30 devstack sudo[88245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b291b36c-8e29-4b4c-993d-47aa11950fc9 Apr 10 10:39:30 devstack sudo[88245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:30 devstack sudo[88243]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-620fc2bf-155d-4eb7-8e81-fdc15b487834 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202.info" returned: 0 in 0.442s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-620fc2bf-155d-4eb7-8e81-fdc15b487834 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.119s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:30 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-620fc2bf-155d-4eb7-8e81-fdc15b487834 tempest-VolumesSnapshotTestJSON-425060456 None] Create snapshot completed successfully Apr 10 10:39:30 devstack sudo[88245]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-76ac885a-a563-4c96-b015-a7e57c37cc0a tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b291b36c-8e29-4b4c-993d-47aa11950fc9" returned: 0 in 0.504s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-76ac885a-a563-4c96-b015-a7e57c37cc0a tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b291b36c-8e29-4b4c-993d-47aa11950fc9 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:30 devstack sudo[88251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b291b36c-8e29-4b4c-993d-47aa11950fc9 Apr 10 10:39:30 devstack sudo[88251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:31 devstack sudo[88251]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-76ac885a-a563-4c96-b015-a7e57c37cc0a tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b291b36c-8e29-4b4c-993d-47aa11950fc9" returned: 0 in 0.461s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:31 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-76ac885a-a563-4c96-b015-a7e57c37cc0a tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "cinder-quobyte-b291b36c-8e29-4b4c-993d-47aa11950fc9" released by "delete_volume" :: held 0.994s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:31 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-76ac885a-a563-4c96-b015-a7e57c37cc0a tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Created reservations ['3d0312a9-13af-433d-88fa-0e6cb770b87e', 'fb4b6c5f-ffdf-4b22-87d6-1085820e75ed', 'a0b10340-3513-4082-bbf3-3922ef494c0f', 'faa6b5de-162d-4536-8f96-53e7cda50a28'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-76ac885a-a563-4c96-b015-a7e57c37cc0a tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-76ac885a-a563-4c96-b015-a7e57c37cc0a tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:31 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-76ac885a-a563-4c96-b015-a7e57c37cc0a tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:31 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-76ac885a-a563-4c96-b015-a7e57c37cc0a tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-76ac885a-a563-4c96-b015-a7e57c37cc0a tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-76ac885a-a563-4c96-b015-a7e57c37cc0a tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:31 devstack sudo[88256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:39:31 devstack sudo[88256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:31 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-ffcbc006-e45f-41e7-85ae-586bee4b522f tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "cinder-83ebd788-f1db-4c23-ac96-253733d36471-delete_snapshot" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:31 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-ffcbc006-e45f-41e7-85ae-586bee4b522f tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-83ebd788-f1db-4c23-ac96-253733d36471-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:31 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-ffcbc006-e45f-41e7-85ae-586bee4b522f tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "cinder-quobyte-2096d6ec-9303-4ed9-a985-6f5bdcd5a202" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:31 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-ffcbc006-e45f-41e7-85ae-586bee4b522f tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-quobyte-2096d6ec-9303-4ed9-a985-6f5bdcd5a202" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:31 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-ffcbc006-e45f-41e7-85ae-586bee4b522f tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "cinder-quobyte-83ebd788-f1db-4c23-ac96-253733d36471" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:31 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-ffcbc006-e45f-41e7-85ae-586bee4b522f tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-quobyte-83ebd788-f1db-4c23-ac96-253733d36471" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:31 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-ffcbc006-e45f-41e7-85ae-586bee4b522f tempest-VolumesSnapshotTestJSON-425060456 None] Deleting offline snapshot 83ebd788-f1db-4c23-ac96-253733d36471 of volume 2096d6ec-9303-4ed9-a985-6f5bdcd5a202 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:39:31 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-ffcbc006-e45f-41e7-85ae-586bee4b522f tempest-VolumesSnapshotTestJSON-425060456 None] snapshot_file for this snap is: volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202.83ebd788-f1db-4c23-ac96-253733d36471 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:39:31 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9325bc-87cd-4322-b932-66208b312603]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-ffcbc006-e45f-41e7-85ae-586bee4b522f tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202.83ebd788-f1db-4c23-ac96-253733d36471 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:31 devstack sudo[88258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202.83ebd788-f1db-4c23-ac96-253733d36471 Apr 10 10:39:31 devstack sudo[88258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:31 devstack sudo[88256]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-76ac885a-a563-4c96-b015-a7e57c37cc0a tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.511s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:31 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-76ac885a-a563-4c96-b015-a7e57c37cc0a tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:31 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-76ac885a-a563-4c96-b015-a7e57c37cc0a tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Deleted volume successfully. Apr 10 10:39:31 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-76ac885a-a563-4c96-b015-a7e57c37cc0a tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "cinder-b291b36c-8e29-4b4c-993d-47aa11950fc9-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:32 devstack sudo[88258]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-ffcbc006-e45f-41e7-85ae-586bee4b522f tempest-VolumesSnapshotTestJSON-425060456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202.83ebd788-f1db-4c23-ac96-253733d36471" returned: 0 in 0.535s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:32 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-ffcbc006-e45f-41e7-85ae-586bee4b522f tempest-VolumesSnapshotTestJSON-425060456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:39:32 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85e06e3-216d-4ff9-8f8b-822edc80d420]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-ffcbc006-e45f-41e7-85ae-586bee4b522f tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:32 devstack sudo[88264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202 Apr 10 10:39:32 devstack sudo[88264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:32 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-facaf6e9-1a75-49d2-a1ad-90b420349fd1 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Acquiring lock "cinder-1b685d5d-1d74-4b8c-a58c-a306196ad2d9-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:32 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-facaf6e9-1a75-49d2-a1ad-90b420349fd1 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "cinder-1b685d5d-1d74-4b8c-a58c-a306196ad2d9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:32 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-facaf6e9-1a75-49d2-a1ad-90b420349fd1 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Acquiring lock "cinder-quobyte-1b685d5d-1d74-4b8c-a58c-a306196ad2d9" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:32 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-facaf6e9-1a75-49d2-a1ad-90b420349fd1 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "cinder-quobyte-1b685d5d-1d74-4b8c-a58c-a306196ad2d9" acquired by "delete_volume" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:32 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[7baa0f3d-c082-4091-8e2c-9cfd15a8b4cb]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-facaf6e9-1a75-49d2-a1ad-90b420349fd1 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1b685d5d-1d74-4b8c-a58c-a306196ad2d9 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:32 devstack sudo[88266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1b685d5d-1d74-4b8c-a58c-a306196ad2d9 Apr 10 10:39:32 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:32 devstack sudo[88264]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-ffcbc006-e45f-41e7-85ae-586bee4b522f tempest-VolumesSnapshotTestJSON-425060456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202" returned: 0 in 0.536s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-ffcbc006-e45f-41e7-85ae-586bee4b522f tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202.83ebd788-f1db-4c23-ac96-253733d36471 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:32 devstack sudo[88271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202.83ebd788-f1db-4c23-ac96-253733d36471 Apr 10 10:39:32 devstack sudo[88271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:33 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-facaf6e9-1a75-49d2-a1ad-90b420349fd1 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1b685d5d-1d74-4b8c-a58c-a306196ad2d9" returned: 0 in 0.560s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-facaf6e9-1a75-49d2-a1ad-90b420349fd1 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1b685d5d-1d74-4b8c-a58c-a306196ad2d9 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:33 devstack sudo[88276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1b685d5d-1d74-4b8c-a58c-a306196ad2d9 Apr 10 10:39:33 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:33 devstack sudo[88271]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-ffcbc006-e45f-41e7-85ae-586bee4b522f tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202.83ebd788-f1db-4c23-ac96-253733d36471" returned: 0 in 0.533s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-ffcbc006-e45f-41e7-85ae-586bee4b522f tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202.83ebd788-f1db-4c23-ac96-253733d36471 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:33 devstack sudo[88281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202.83ebd788-f1db-4c23-ac96-253733d36471 Apr 10 10:39:33 devstack sudo[88281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:33 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-facaf6e9-1a75-49d2-a1ad-90b420349fd1 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1b685d5d-1d74-4b8c-a58c-a306196ad2d9" returned: 0 in 0.474s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:33 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-facaf6e9-1a75-49d2-a1ad-90b420349fd1 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "cinder-quobyte-1b685d5d-1d74-4b8c-a58c-a306196ad2d9" released by "delete_volume" :: held 1.078s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:33 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-facaf6e9-1a75-49d2-a1ad-90b420349fd1 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Created reservations ['2e184324-dd75-4185-b9bb-429092616c45', '33f2aff9-2430-44eb-a228-65eb5f7b0f36', '4503b6dc-946a-49f3-ab4b-2d62249e2b20', 'cfce7fda-b769-4b4d-9b03-f6aead42c677'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-facaf6e9-1a75-49d2-a1ad-90b420349fd1 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-facaf6e9-1a75-49d2-a1ad-90b420349fd1 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:33 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-facaf6e9-1a75-49d2-a1ad-90b420349fd1 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:33 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-facaf6e9-1a75-49d2-a1ad-90b420349fd1 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-facaf6e9-1a75-49d2-a1ad-90b420349fd1 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-facaf6e9-1a75-49d2-a1ad-90b420349fd1 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:33 devstack sudo[88284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:39:33 devstack sudo[88284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:33 devstack sudo[88281]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-ffcbc006-e45f-41e7-85ae-586bee4b522f tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202.83ebd788-f1db-4c23-ac96-253733d36471" returned: 0 in 0.480s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:33 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-ffcbc006-e45f-41e7-85ae-586bee4b522f tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-quobyte-83ebd788-f1db-4c23-ac96-253733d36471" released by "_delete_snapshot" :: held 2.155s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:33 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-ffcbc006-e45f-41e7-85ae-586bee4b522f tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-quobyte-2096d6ec-9303-4ed9-a985-6f5bdcd5a202" released by "delete_snapshot" :: held 2.173s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:34 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-ffcbc006-e45f-41e7-85ae-586bee4b522f tempest-VolumesSnapshotTestJSON-425060456 None] Created reservations ['912ad970-14e9-4ea7-a280-f2672812f18d', 'd84e3dcc-4e27-40d0-a38a-3355d9169ced', '9d5db510-edeb-4d0f-90ee-8c735c1e6b4e', '28ec066d-f5dd-4c8e-bea4-3e3e651cfe73'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:34 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-ffcbc006-e45f-41e7-85ae-586bee4b522f tempest-VolumesSnapshotTestJSON-425060456 None] Delete snapshot completed successfully. Apr 10 10:39:34 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-ffcbc006-e45f-41e7-85ae-586bee4b522f tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-83ebd788-f1db-4c23-ac96-253733d36471-delete_snapshot" released by "delete_snapshot" :: held 2.302s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:34 devstack sudo[88284]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-facaf6e9-1a75-49d2-a1ad-90b420349fd1 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.448s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:34 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-facaf6e9-1a75-49d2-a1ad-90b420349fd1 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:34 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-facaf6e9-1a75-49d2-a1ad-90b420349fd1 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Deleted volume successfully. Apr 10 10:39:34 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-facaf6e9-1a75-49d2-a1ad-90b420349fd1 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "cinder-1b685d5d-1d74-4b8c-a58c-a306196ad2d9-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:34 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-25436990-9daa-4a8e-bada-521fe02ccc38 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Acquiring lock "cinder-78f2898b-24e8-4cce-87da-d362b36a1829-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:34 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-25436990-9daa-4a8e-bada-521fe02ccc38 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "cinder-78f2898b-24e8-4cce-87da-d362b36a1829-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:34 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-25436990-9daa-4a8e-bada-521fe02ccc38 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Acquiring lock "cinder-quobyte-78f2898b-24e8-4cce-87da-d362b36a1829" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:34 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-25436990-9daa-4a8e-bada-521fe02ccc38 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "cinder-quobyte-78f2898b-24e8-4cce-87da-d362b36a1829" acquired by "delete_volume" :: waited 0.011s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:34 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b85e64-754f-4fda-977c-404e577067a9]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-25436990-9daa-4a8e-bada-521fe02ccc38 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-78f2898b-24e8-4cce-87da-d362b36a1829 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:34 devstack sudo[88288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-78f2898b-24e8-4cce-87da-d362b36a1829 Apr 10 10:39:34 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] Flow 'volume_create_manager' (5953080b-f1fa-4921-a713-77b789abd0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a5a3d0a-1699-421e-9112-75fc25b3989c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a5a3d0a-1699-421e-9112-75fc25b3989c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-226124178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e920bd13-e46f-468c-a26a-df85e0dc934c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa770f15210f4eabbda91dd1cd3eb2b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:35Z,use_quota=True,user_id='2b5d468127fe4700b9eed0ba7cc1c590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01b4c955-1493-419c-a51a-dee1bc725506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01b4c955-1493-419c-a51a-dee1bc725506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3864d4f-580d-4ac0-9117-81cd94fa0ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3864d4f-580d-4ac0-9117-81cd94fa0ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e920bd13-e46f-468c-a26a-df85e0dc934c', 'volume_name': 'volume-e920bd13-e46f-468c-a26a-df85e0dc934c', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:35 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0111d78c-372f-4bbf-a0e1-c777bfbd8f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0111d78c-372f-4bbf-a0e1-c777bfbd8f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b18e0b64-aa5f-4232-a0f0-4e8251b13ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:35 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] Volume e920bd13-e46f-468c-a26a-df85e0dc934c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e920bd13-e46f-468c-a26a-df85e0dc934c', 'volume_size': 1} Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-226124178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e920bd13-e46f-468c-a26a-df85e0dc934c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa770f15210f4eabbda91dd1cd3eb2b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:35Z,use_quota=True,user_id='2b5d468127fe4700b9eed0ba7cc1c590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] Creating volume e920bd13-e46f-468c-a26a-df85e0dc934c {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:35 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-25436990-9daa-4a8e-bada-521fe02ccc38 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-78f2898b-24e8-4cce-87da-d362b36a1829" returned: 0 in 0.550s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-25436990-9daa-4a8e-bada-521fe02ccc38 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-78f2898b-24e8-4cce-87da-d362b36a1829 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:35 devstack sudo[88293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c 1073741824 Apr 10 10:39:35 devstack sudo[88293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:35 devstack sudo[88294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-78f2898b-24e8-4cce-87da-d362b36a1829 Apr 10 10:39:35 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:35 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-25436990-9daa-4a8e-bada-521fe02ccc38 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-78f2898b-24e8-4cce-87da-d362b36a1829" returned: 0 in 0.437s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-25436990-9daa-4a8e-bada-521fe02ccc38 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "cinder-quobyte-78f2898b-24e8-4cce-87da-d362b36a1829" released by "delete_volume" :: held 1.020s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-25436990-9daa-4a8e-bada-521fe02ccc38 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Created reservations ['210f9475-6ef3-44d7-845c-422f5ded6ad6', '15e288c8-b534-46e8-878f-60e37c2e56d4', 'bd1603f4-2cbc-4b44-98cf-3a62bbedddc4', 'a412e9ac-f734-4cbf-80d1-e289f1092e9b'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:35 devstack sudo[88293]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c 1073741824" returned: 0 in 0.570s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-25436990-9daa-4a8e-bada-521fe02ccc38 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-25436990-9daa-4a8e-bada-521fe02ccc38 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-25436990-9daa-4a8e-bada-521fe02ccc38 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-25436990-9daa-4a8e-bada-521fe02ccc38 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-25436990-9daa-4a8e-bada-521fe02ccc38 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-25436990-9daa-4a8e-bada-521fe02ccc38 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:35 devstack sudo[88301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:39:35 devstack sudo[88301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:35 devstack sudo[88303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c Apr 10 10:39:35 devstack sudo[88303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:36 devstack sudo[88301]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-25436990-9daa-4a8e-bada-521fe02ccc38 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.431s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:36 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-25436990-9daa-4a8e-bada-521fe02ccc38 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:36 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-25436990-9daa-4a8e-bada-521fe02ccc38 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Deleted volume successfully. Apr 10 10:39:36 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-25436990-9daa-4a8e-bada-521fe02ccc38 tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "cinder-78f2898b-24e8-4cce-87da-d362b36a1829-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:36 devstack sudo[88303]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c" returned: 0 in 0.472s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:36 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:39:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b18e0b64-aa5f-4232-a0f0-4e8251b13ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e920bd13-e46f-468c-a26a-df85e0dc934c', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (736c8e19-5df4-444e-a870-2426c7e2673e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:36 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] Volume volume-e920bd13-e46f-468c-a26a-df85e0dc934c (e920bd13-e46f-468c-a26a-df85e0dc934c): created successfully Apr 10 10:39:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (736c8e19-5df4-444e-a870-2426c7e2673e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] Flow 'volume_create_manager' (5953080b-f1fa-4921-a713-77b789abd0f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:36 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-b1ca2c0c-96bc-4ef2-9ff6-2c56aa7587a9 tempest-VolumesSnapshotTestJSON-425060456 None] Created volume successfully. Apr 10 10:39:36 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-bb9e4809-ea6a-485b-8c5a-7c22f5c6f1df tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Acquiring lock "cinder-05c0a232-c02f-4f0a-abc0-67eeaf9464df-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:36 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-bb9e4809-ea6a-485b-8c5a-7c22f5c6f1df tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "cinder-05c0a232-c02f-4f0a-abc0-67eeaf9464df-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:36 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-bb9e4809-ea6a-485b-8c5a-7c22f5c6f1df tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Acquiring lock "cinder-quobyte-05c0a232-c02f-4f0a-abc0-67eeaf9464df" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:36 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-bb9e4809-ea6a-485b-8c5a-7c22f5c6f1df tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "cinder-quobyte-05c0a232-c02f-4f0a-abc0-67eeaf9464df" acquired by "delete_volume" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:36 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77f04ee-58d1-4a19-b5fb-2493f3dffd8f]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bb9e4809-ea6a-485b-8c5a-7c22f5c6f1df tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-05c0a232-c02f-4f0a-abc0-67eeaf9464df {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:37 devstack sudo[88307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-05c0a232-c02f-4f0a-abc0-67eeaf9464df Apr 10 10:39:37 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-bc4b591a-a010-4974-9d4a-d09895a2f9f2 tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-bc4b591a-a010-4974-9d4a-d09895a2f9f2 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:37 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-bc4b591a-a010-4974-9d4a-d09895a2f9f2 tempest-VolumesSnapshotTestJSON-425060456 None] Creating offline snapshot f4adc935-2e36-4f39-8fab-2ef67ceaf365 of volume e920bd13-e46f-468c-a26a-df85e0dc934c {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:39:37 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff8b504-5e67-42b1-a4d9-ffee66f27806]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bc4b591a-a010-4974-9d4a-d09895a2f9f2 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:37 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bb9e4809-ea6a-485b-8c5a-7c22f5c6f1df tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-05c0a232-c02f-4f0a-abc0-67eeaf9464df" returned: 0 in 0.544s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bb9e4809-ea6a-485b-8c5a-7c22f5c6f1df tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-05c0a232-c02f-4f0a-abc0-67eeaf9464df {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:37 devstack sudo[88313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-05c0a232-c02f-4f0a-abc0-67eeaf9464df Apr 10 10:39:37 devstack sudo[88313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:37 devstack sudo[88312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c Apr 10 10:39:37 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:37 devstack sudo[88313]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bb9e4809-ea6a-485b-8c5a-7c22f5c6f1df tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-05c0a232-c02f-4f0a-abc0-67eeaf9464df" returned: 0 in 0.469s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:37 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-bb9e4809-ea6a-485b-8c5a-7c22f5c6f1df tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "cinder-quobyte-05c0a232-c02f-4f0a-abc0-67eeaf9464df" released by "delete_volume" :: held 1.039s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:38 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-bb9e4809-ea6a-485b-8c5a-7c22f5c6f1df tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Created reservations ['4c9c80b3-8231-4d15-a1ec-99c9a5f8e123', '2d8c0a43-e901-40f5-a64c-eb9d137ba46b', 'ceb90c36-4ae4-48fe-b75d-0b22d4795b70', 'fe41463a-787d-45d1-9ce3-0c0eca096b7f'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-bb9e4809-ea6a-485b-8c5a-7c22f5c6f1df tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-bb9e4809-ea6a-485b-8c5a-7c22f5c6f1df tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:38 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-bb9e4809-ea6a-485b-8c5a-7c22f5c6f1df tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:38 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-bb9e4809-ea6a-485b-8c5a-7c22f5c6f1df tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:38 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-bb9e4809-ea6a-485b-8c5a-7c22f5c6f1df tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bb9e4809-ea6a-485b-8c5a-7c22f5c6f1df tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bc4b591a-a010-4974-9d4a-d09895a2f9f2 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c" returned: 0 in 0.599s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bc4b591a-a010-4974-9d4a-d09895a2f9f2 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c.f4adc935-2e36-4f39-8fab-2ef67ceaf365 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:38 devstack sudo[88320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:39:38 devstack sudo[88320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:38 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c.f4adc935-2e36-4f39-8fab-2ef67ceaf365 1G Apr 10 10:39:38 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:38 devstack sudo[88320]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bb9e4809-ea6a-485b-8c5a-7c22f5c6f1df tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.437s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:38 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-bb9e4809-ea6a-485b-8c5a-7c22f5c6f1df tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:38 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-bb9e4809-ea6a-485b-8c5a-7c22f5c6f1df tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Deleted volume successfully. Apr 10 10:39:38 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-bb9e4809-ea6a-485b-8c5a-7c22f5c6f1df tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "cinder-05c0a232-c02f-4f0a-abc0-67eeaf9464df-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:38 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bc4b591a-a010-4974-9d4a-d09895a2f9f2 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c.f4adc935-2e36-4f39-8fab-2ef67ceaf365 1G" returned: 0 in 0.515s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bc4b591a-a010-4974-9d4a-d09895a2f9f2 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e920bd13-e46f-468c-a26a-df85e0dc934c -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c.f4adc935-2e36-4f39-8fab-2ef67ceaf365 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:38 devstack sudo[88328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e920bd13-e46f-468c-a26a-df85e0dc934c -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c.f4adc935-2e36-4f39-8fab-2ef67ceaf365 Apr 10 10:39:38 devstack sudo[88328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:39 devstack sudo[88328]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bc4b591a-a010-4974-9d4a-d09895a2f9f2 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e920bd13-e46f-468c-a26a-df85e0dc934c -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c.f4adc935-2e36-4f39-8fab-2ef67ceaf365" returned: 0 in 0.458s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:39 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-bc4b591a-a010-4974-9d4a-d09895a2f9f2 tempest-VolumesSnapshotTestJSON-425060456 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c.f4adc935-2e36-4f39-8fab-2ef67ceaf365 is being set with open permissions: ugo+rw Apr 10 10:39:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bc4b591a-a010-4974-9d4a-d09895a2f9f2 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c.f4adc935-2e36-4f39-8fab-2ef67ceaf365 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:39 devstack sudo[88333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c.f4adc935-2e36-4f39-8fab-2ef67ceaf365 Apr 10 10:39:39 devstack sudo[88333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:39 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6d3c602b-cbda-4646-99e1-37285c19120e tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Acquiring lock "cinder-decea743-16f9-4b1e-b437-c426bead3036-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:39 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6d3c602b-cbda-4646-99e1-37285c19120e tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "cinder-decea743-16f9-4b1e-b437-c426bead3036-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:39 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6d3c602b-cbda-4646-99e1-37285c19120e tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Acquiring lock "cinder-quobyte-decea743-16f9-4b1e-b437-c426bead3036" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:39 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6d3c602b-cbda-4646-99e1-37285c19120e tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "cinder-quobyte-decea743-16f9-4b1e-b437-c426bead3036" acquired by "delete_volume" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:39 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ee967e-0bda-47b2-b7b5-a04920240e2d]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6d3c602b-cbda-4646-99e1-37285c19120e tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decea743-16f9-4b1e-b437-c426bead3036 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:39 devstack sudo[88335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decea743-16f9-4b1e-b437-c426bead3036 Apr 10 10:39:39 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:39 devstack sudo[88333]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bc4b591a-a010-4974-9d4a-d09895a2f9f2 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c.f4adc935-2e36-4f39-8fab-2ef67ceaf365" returned: 0 in 0.451s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bc4b591a-a010-4974-9d4a-d09895a2f9f2 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:39 devstack sudo[88338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c.info Apr 10 10:39:39 devstack sudo[88338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:39 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6d3c602b-cbda-4646-99e1-37285c19120e tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decea743-16f9-4b1e-b437-c426bead3036" returned: 0 in 0.520s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6d3c602b-cbda-4646-99e1-37285c19120e tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decea743-16f9-4b1e-b437-c426bead3036 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:39 devstack sudo[88343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decea743-16f9-4b1e-b437-c426bead3036 Apr 10 10:39:39 devstack sudo[88343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:39 devstack sudo[88338]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bc4b591a-a010-4974-9d4a-d09895a2f9f2 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c.info" returned: 0 in 0.452s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:39 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-bc4b591a-a010-4974-9d4a-d09895a2f9f2 tempest-VolumesSnapshotTestJSON-425060456 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c.info is being set with open permissions: ugo+rw Apr 10 10:39:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bc4b591a-a010-4974-9d4a-d09895a2f9f2 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:40 devstack sudo[88347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c.info Apr 10 10:39:40 devstack sudo[88347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:40 devstack sudo[88343]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6d3c602b-cbda-4646-99e1-37285c19120e tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decea743-16f9-4b1e-b437-c426bead3036" returned: 0 in 0.435s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:40 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6d3c602b-cbda-4646-99e1-37285c19120e tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "cinder-quobyte-decea743-16f9-4b1e-b437-c426bead3036" released by "delete_volume" :: held 0.994s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:40 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-6d3c602b-cbda-4646-99e1-37285c19120e tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Created reservations ['8b7fe3b7-c182-4cec-a235-ea8b6e6358ce', '3221e1fe-3303-4d01-9d79-e8c75905de6c', '5612167a-7130-4329-a62b-baa880db6069', '041f0a0a-df95-4814-84ca-d04a34183394'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6d3c602b-cbda-4646-99e1-37285c19120e tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6d3c602b-cbda-4646-99e1-37285c19120e tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:40 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6d3c602b-cbda-4646-99e1-37285c19120e tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:40 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6d3c602b-cbda-4646-99e1-37285c19120e tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6d3c602b-cbda-4646-99e1-37285c19120e tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6d3c602b-cbda-4646-99e1-37285c19120e tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:40 devstack sudo[88350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:39:40 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:40 devstack sudo[88347]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bc4b591a-a010-4974-9d4a-d09895a2f9f2 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c.info" returned: 0 in 0.437s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-bc4b591a-a010-4974-9d4a-d09895a2f9f2 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.980s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:40 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-bc4b591a-a010-4974-9d4a-d09895a2f9f2 tempest-VolumesSnapshotTestJSON-425060456 None] Create snapshot completed successfully Apr 10 10:39:40 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6d3c602b-cbda-4646-99e1-37285c19120e tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.532s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:40 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-6d3c602b-cbda-4646-99e1-37285c19120e tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:40 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-6d3c602b-cbda-4646-99e1-37285c19120e tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Deleted volume successfully. Apr 10 10:39:40 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6d3c602b-cbda-4646-99e1-37285c19120e tempest-CreateVolumesFromSourceVolumeTest-1138179975 None] Lock "cinder-decea743-16f9-4b1e-b437-c426bead3036-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:40 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Flow 'volume_create_manager' (9197fd76-3846-467b-86e6-e39c659d60ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca6a5217-f4e7-4efe-8d6a-633e4ba5749c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca6a5217-f4e7-4efe-8d6a-633e4ba5749c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1898500615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc687d07-4539-4c17-9572-e01c9e1841f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa770f15210f4eabbda91dd1cd3eb2b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=f4adc935-2e36-4f39-8fab-2ef67ceaf365,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:41Z,use_quota=True,user_id='2b5d468127fe4700b9eed0ba7cc1c590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ad3b3b-646f-4563-93f8-a2b1f00b0957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ad3b3b-646f-4563-93f8-a2b1f00b0957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0cca72a-ac1f-4be3-9f4b-d958ed76ecfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0cca72a-ac1f-4be3-9f4b-d958ed76ecfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dc687d07-4539-4c17-9572-e01c9e1841f0', 'volume_name': 'volume-dc687d07-4539-4c17-9572-e01c9e1841f0', 'volume_size': 2, 'snapshot_id': 'f4adc935-2e36-4f39-8fab-2ef67ceaf365'}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:40 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17b46bea-a59d-4cb7-9571-c3e064251250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:41 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17b46bea-a59d-4cb7-9571-c3e064251250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:41 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed09f9f-f18a-41a4-ad3a-1161748803bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:41 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Volume dc687d07-4539-4c17-9572-e01c9e1841f0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dc687d07-4539-4c17-9572-e01c9e1841f0', 'volume_size': 2, 'snapshot_id': 'f4adc935-2e36-4f39-8fab-2ef67ceaf365'} Apr 10 10:39:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:41 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "cinder-quobyte-f4adc935-2e36-4f39-8fab-2ef67ceaf365-dc687d07-4539-4c17-9572-e01c9e1841f0" by "_create_volume_from_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:41 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-quobyte-f4adc935-2e36-4f39-8fab-2ef67ceaf365-dc687d07-4539-4c17-9572-e01c9e1841f0" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:41 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Creating volume dc687d07-4539-4c17-9572-e01c9e1841f0 from snapshot f4adc935-2e36-4f39-8fab-2ef67ceaf365 {{(pid=81938) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 10:39:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:41 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:41 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:41 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:41 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "cinder-quobyte-dc687d07-4539-4c17-9572-e01c9e1841f0" by "_copy_volume_from_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:41 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-quobyte-dc687d07-4539-4c17-9572-e01c9e1841f0" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:41 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] snapshot: f4adc935-2e36-4f39-8fab-2ef67ceaf365, volume: dc687d07-4539-4c17-9572-e01c9e1841f0, {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:39:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:41 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:41 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:41 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[593851c5-0291-4048-b90b-5f6dc5687da1]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c.f4adc935-2e36-4f39-8fab-2ef67ceaf365 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:41 devstack sudo[88354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c.f4adc935-2e36-4f39-8fab-2ef67ceaf365 Apr 10 10:39:41 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:41 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c.f4adc935-2e36-4f39-8fab-2ef67ceaf365" returned: 0 in 0.551s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:41 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e920bd13-e46f-468c-a26a-df85e0dc934c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:39:41 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:39:41 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Creating direct copy from snapshot {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:39:41 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[c301d517-1ec1-4682-a40b-925b64382b4a]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:41 devstack sudo[88359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c Apr 10 10:39:41 devstack sudo[88359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:42 devstack sudo[88359]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c" returned: 0 in 0.518s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:42 devstack cinder-volume[81938]: DEBUG cinder.utils [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Path /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dc687d07-4539-4c17-9572-e01c9e1841f0 not found in is_blk_device check {{(pid=81938) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:39:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dc687d07-4539-4c17-9572-e01c9e1841f0 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:42 devstack sudo[88364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dc687d07-4539-4c17-9572-e01c9e1841f0 Apr 10 10:39:42 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:44 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dc687d07-4539-4c17-9572-e01c9e1841f0" returned: 0 in 2.162s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:44 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[1886031b-c392-4b9a-ba8c-f320ecc42f23]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:44 devstack sudo[88376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c Apr 10 10:39:44 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:44 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c" returned: 0 in 0.594s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:44 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c, size 1024.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dc687d07-4539-4c17-9572-e01c9e1841f0 {{(pid=81938) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:39:44 devstack cinder-volume[81938]: INFO cinder.image.image_utils [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Converted 1024.00 MB image at 473.44 MB/s Apr 10 10:39:44 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dc687d07-4539-4c17-9572-e01c9e1841f0 is being set with open permissions: ugo+rw Apr 10 10:39:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dc687d07-4539-4c17-9572-e01c9e1841f0 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:44 devstack sudo[88381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dc687d07-4539-4c17-9572-e01c9e1841f0 Apr 10 10:39:44 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:45 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dc687d07-4539-4c17-9572-e01c9e1841f0" returned: 0 in 0.426s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:45 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-quobyte-dc687d07-4539-4c17-9572-e01c9e1841f0" released by "_copy_volume_from_snapshot" :: held 4.312s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:45 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-quobyte-f4adc935-2e36-4f39-8fab-2ef67ceaf365-dc687d07-4539-4c17-9572-e01c9e1841f0" released by "_create_volume_from_snapshot" :: held 4.336s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.343s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed09f9f-f18a-41a4-ad3a-1161748803bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc687d07-4539-4c17-9572-e01c9e1841f0', 'volume_size': 2, 'snapshot_id': 'f4adc935-2e36-4f39-8fab-2ef67ceaf365'}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bfd1ad5-d1eb-4989-94db-7185a119eb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:45 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Volume volume-dc687d07-4539-4c17-9572-e01c9e1841f0 (dc687d07-4539-4c17-9572-e01c9e1841f0): created successfully Apr 10 10:39:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bfd1ad5-d1eb-4989-94db-7185a119eb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:45 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Flow 'volume_create_manager' (9197fd76-3846-467b-86e6-e39c659d60ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:45 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writing DB stats cinder:SELECT=140,cinder:INSERT=45,cinder:UPDATE=157,cinder:DELETE=17 {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:39:45 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-831173f1-c3d7-4495-bef8-6774b34bdddf tempest-VolumesSnapshotTestJSON-425060456 None] Created volume successfully. Apr 10 10:39:46 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-00650a71-2f16-409f-9f9f-1e08a9d82758 tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "cinder-dc687d07-4539-4c17-9572-e01c9e1841f0-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:46 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-00650a71-2f16-409f-9f9f-1e08a9d82758 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-dc687d07-4539-4c17-9572-e01c9e1841f0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:46 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-00650a71-2f16-409f-9f9f-1e08a9d82758 tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "cinder-quobyte-dc687d07-4539-4c17-9572-e01c9e1841f0" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:46 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-00650a71-2f16-409f-9f9f-1e08a9d82758 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-quobyte-dc687d07-4539-4c17-9572-e01c9e1841f0" acquired by "delete_volume" :: waited 0.007s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:46 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[4637e059-be91-43d9-ad69-4e2ef5cef3e9]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-00650a71-2f16-409f-9f9f-1e08a9d82758 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dc687d07-4539-4c17-9572-e01c9e1841f0 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:46 devstack sudo[88384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dc687d07-4539-4c17-9572-e01c9e1841f0 Apr 10 10:39:46 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:46 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-00650a71-2f16-409f-9f9f-1e08a9d82758 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dc687d07-4539-4c17-9572-e01c9e1841f0" returned: 0 in 0.484s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-00650a71-2f16-409f-9f9f-1e08a9d82758 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dc687d07-4539-4c17-9572-e01c9e1841f0 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:46 devstack sudo[88389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dc687d07-4539-4c17-9572-e01c9e1841f0 Apr 10 10:39:46 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:47 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-00650a71-2f16-409f-9f9f-1e08a9d82758 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-dc687d07-4539-4c17-9572-e01c9e1841f0" returned: 0 in 0.430s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:47 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-00650a71-2f16-409f-9f9f-1e08a9d82758 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-quobyte-dc687d07-4539-4c17-9572-e01c9e1841f0" released by "delete_volume" :: held 0.942s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:47 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-00650a71-2f16-409f-9f9f-1e08a9d82758 tempest-VolumesSnapshotTestJSON-425060456 None] Created reservations ['14c852fc-e9be-4222-b579-f44ec7085250', '2cc7cfae-8c45-44ca-881e-dbe6ebc5d5e9', '3d3f60a5-f91f-4df1-ac21-d61ba6aead68', '14317698-05a6-424b-a580-7692e78ab04e'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-00650a71-2f16-409f-9f9f-1e08a9d82758 tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-00650a71-2f16-409f-9f9f-1e08a9d82758 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:47 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-00650a71-2f16-409f-9f9f-1e08a9d82758 tempest-VolumesSnapshotTestJSON-425060456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:47 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-00650a71-2f16-409f-9f9f-1e08a9d82758 tempest-VolumesSnapshotTestJSON-425060456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-00650a71-2f16-409f-9f9f-1e08a9d82758 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-00650a71-2f16-409f-9f9f-1e08a9d82758 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:47 devstack sudo[88392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:39:47 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:47 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f17c0222-4a5f-453e-9ccc-be97e3ea530d tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "cinder-f4adc935-2e36-4f39-8fab-2ef67ceaf365-delete_snapshot" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:47 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f17c0222-4a5f-453e-9ccc-be97e3ea530d tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-f4adc935-2e36-4f39-8fab-2ef67ceaf365-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:47 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f17c0222-4a5f-453e-9ccc-be97e3ea530d tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "cinder-quobyte-e920bd13-e46f-468c-a26a-df85e0dc934c" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:47 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f17c0222-4a5f-453e-9ccc-be97e3ea530d tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-quobyte-e920bd13-e46f-468c-a26a-df85e0dc934c" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:47 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f17c0222-4a5f-453e-9ccc-be97e3ea530d tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "cinder-quobyte-f4adc935-2e36-4f39-8fab-2ef67ceaf365" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:47 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f17c0222-4a5f-453e-9ccc-be97e3ea530d tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-quobyte-f4adc935-2e36-4f39-8fab-2ef67ceaf365" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:47 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-f17c0222-4a5f-453e-9ccc-be97e3ea530d tempest-VolumesSnapshotTestJSON-425060456 None] Deleting offline snapshot f4adc935-2e36-4f39-8fab-2ef67ceaf365 of volume e920bd13-e46f-468c-a26a-df85e0dc934c {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:39:47 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-f17c0222-4a5f-453e-9ccc-be97e3ea530d tempest-VolumesSnapshotTestJSON-425060456 None] snapshot_file for this snap is: volume-e920bd13-e46f-468c-a26a-df85e0dc934c.f4adc935-2e36-4f39-8fab-2ef67ceaf365 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:39:47 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b2fba5-dc2e-4c79-9481-6826ebb30343]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f17c0222-4a5f-453e-9ccc-be97e3ea530d tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c.f4adc935-2e36-4f39-8fab-2ef67ceaf365 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:47 devstack sudo[88394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c.f4adc935-2e36-4f39-8fab-2ef67ceaf365 Apr 10 10:39:47 devstack sudo[88394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:47 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-00650a71-2f16-409f-9f9f-1e08a9d82758 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.466s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:47 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-00650a71-2f16-409f-9f9f-1e08a9d82758 tempest-VolumesSnapshotTestJSON-425060456 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:47 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-00650a71-2f16-409f-9f9f-1e08a9d82758 tempest-VolumesSnapshotTestJSON-425060456 None] Deleted volume successfully. Apr 10 10:39:47 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-00650a71-2f16-409f-9f9f-1e08a9d82758 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-dc687d07-4539-4c17-9572-e01c9e1841f0-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:48 devstack cinder-volume[81938]: DEBUG oslo_service.periodic_task [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81938) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:39:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:48 devstack sudo[88400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:39:48 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:48 devstack sudo[88394]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f17c0222-4a5f-453e-9ccc-be97e3ea530d tempest-VolumesSnapshotTestJSON-425060456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c.f4adc935-2e36-4f39-8fab-2ef67ceaf365" returned: 0 in 0.543s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-f17c0222-4a5f-453e-9ccc-be97e3ea530d tempest-VolumesSnapshotTestJSON-425060456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e920bd13-e46f-468c-a26a-df85e0dc934c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:39:48 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0071b97-bc36-4432-a2d4-4901f1edbc3d]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f17c0222-4a5f-453e-9ccc-be97e3ea530d tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:48 devstack sudo[88402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c Apr 10 10:39:48 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:48 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.527s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:48 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:48 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f17c0222-4a5f-453e-9ccc-be97e3ea530d tempest-VolumesSnapshotTestJSON-425060456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c" returned: 0 in 0.543s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f17c0222-4a5f-453e-9ccc-be97e3ea530d tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c.f4adc935-2e36-4f39-8fab-2ef67ceaf365 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:48 devstack sudo[88408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c.f4adc935-2e36-4f39-8fab-2ef67ceaf365 Apr 10 10:39:48 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:49 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f17c0222-4a5f-453e-9ccc-be97e3ea530d tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c.f4adc935-2e36-4f39-8fab-2ef67ceaf365" returned: 0 in 0.503s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f17c0222-4a5f-453e-9ccc-be97e3ea530d tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c.f4adc935-2e36-4f39-8fab-2ef67ceaf365 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:49 devstack sudo[88419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c.f4adc935-2e36-4f39-8fab-2ef67ceaf365 Apr 10 10:39:49 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:49 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f17c0222-4a5f-453e-9ccc-be97e3ea530d tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c.f4adc935-2e36-4f39-8fab-2ef67ceaf365" returned: 0 in 0.464s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:49 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f17c0222-4a5f-453e-9ccc-be97e3ea530d tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-quobyte-f4adc935-2e36-4f39-8fab-2ef67ceaf365" released by "_delete_snapshot" :: held 2.118s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:49 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f17c0222-4a5f-453e-9ccc-be97e3ea530d tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-quobyte-e920bd13-e46f-468c-a26a-df85e0dc934c" released by "delete_snapshot" :: held 2.135s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:49 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-f17c0222-4a5f-453e-9ccc-be97e3ea530d tempest-VolumesSnapshotTestJSON-425060456 None] Created reservations ['743a8ca5-6080-489e-8238-8370ca10fc01', 'd7545575-b3e2-4bc4-ab5e-2875eb4aa4bf', '1d76d026-2f2c-4023-bbb7-a7ac5d5108b1', 'bfe39829-e1a6-44e0-9567-4f5915ed80e4'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:49 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-f17c0222-4a5f-453e-9ccc-be97e3ea530d tempest-VolumesSnapshotTestJSON-425060456 None] Delete snapshot completed successfully. Apr 10 10:39:49 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f17c0222-4a5f-453e-9ccc-be97e3ea530d tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-f4adc935-2e36-4f39-8fab-2ef67ceaf365-delete_snapshot" released by "delete_snapshot" :: held 2.233s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:50 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c439cdba-70b0-472c-9d80-209e188f7872 tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "cinder-e920bd13-e46f-468c-a26a-df85e0dc934c-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:50 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c439cdba-70b0-472c-9d80-209e188f7872 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-e920bd13-e46f-468c-a26a-df85e0dc934c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:50 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c439cdba-70b0-472c-9d80-209e188f7872 tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "cinder-quobyte-e920bd13-e46f-468c-a26a-df85e0dc934c" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:50 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c439cdba-70b0-472c-9d80-209e188f7872 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-quobyte-e920bd13-e46f-468c-a26a-df85e0dc934c" acquired by "delete_volume" :: waited 0.011s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:50 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc28010-d10a-4ee1-bd0e-e77746bed2bf]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c439cdba-70b0-472c-9d80-209e188f7872 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:50 devstack sudo[88423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c Apr 10 10:39:50 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:51 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c439cdba-70b0-472c-9d80-209e188f7872 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c" returned: 0 in 0.519s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c439cdba-70b0-472c-9d80-209e188f7872 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:51 devstack sudo[88428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c Apr 10 10:39:51 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:51 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c439cdba-70b0-472c-9d80-209e188f7872 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e920bd13-e46f-468c-a26a-df85e0dc934c" returned: 0 in 0.435s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:51 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c439cdba-70b0-472c-9d80-209e188f7872 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-quobyte-e920bd13-e46f-468c-a26a-df85e0dc934c" released by "delete_volume" :: held 0.992s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:51 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-c439cdba-70b0-472c-9d80-209e188f7872 tempest-VolumesSnapshotTestJSON-425060456 None] Created reservations ['1d87baf9-7e23-46bd-9b05-555add88fb7c', '89a05c9c-9aef-4fab-95a1-ae4755464001', '1fc0e973-4402-4e6a-926e-23338e06ace1', '1b9abe48-faea-4cfe-ba63-f93315cf8837'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c439cdba-70b0-472c-9d80-209e188f7872 tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c439cdba-70b0-472c-9d80-209e188f7872 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:51 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c439cdba-70b0-472c-9d80-209e188f7872 tempest-VolumesSnapshotTestJSON-425060456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:51 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c439cdba-70b0-472c-9d80-209e188f7872 tempest-VolumesSnapshotTestJSON-425060456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c439cdba-70b0-472c-9d80-209e188f7872 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c439cdba-70b0-472c-9d80-209e188f7872 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:51 devstack sudo[88431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:39:51 devstack sudo[88431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:52 devstack sudo[88431]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c439cdba-70b0-472c-9d80-209e188f7872 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.484s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:52 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-c439cdba-70b0-472c-9d80-209e188f7872 tempest-VolumesSnapshotTestJSON-425060456 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:52 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-c439cdba-70b0-472c-9d80-209e188f7872 tempest-VolumesSnapshotTestJSON-425060456 None] Deleted volume successfully. Apr 10 10:39:52 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c439cdba-70b0-472c-9d80-209e188f7872 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-e920bd13-e46f-468c-a26a-df85e0dc934c-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:53 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:53 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] Flow 'volume_create_manager' (3b169de0-3050-4b25-81f8-2e6dc3559cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:53 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (772b29a3-69b8-40fa-be39-bf0a2138d21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:53 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (772b29a3-69b8-40fa-be39-bf0a2138d21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-289092931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c11592ea-4e5f-43ec-874d-2405d661eec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa770f15210f4eabbda91dd1cd3eb2b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:53Z,use_quota=True,user_id='2b5d468127fe4700b9eed0ba7cc1c590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:53 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a473a917-e6d3-4e8b-a04e-389357d46b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:53 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a473a917-e6d3-4e8b-a04e-389357d46b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:53 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c56367-8870-4517-a8e7-55a23a0f28a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:53 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c56367-8870-4517-a8e7-55a23a0f28a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c11592ea-4e5f-43ec-874d-2405d661eec3', 'volume_name': 'volume-c11592ea-4e5f-43ec-874d-2405d661eec3', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:53 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7a0c4d-e57c-44b2-9da7-1c98c860176d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:53 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7a0c4d-e57c-44b2-9da7-1c98c860176d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:53 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1980da7-9a04-405c-9f40-7f269a1b29ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:53 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] Volume c11592ea-4e5f-43ec-874d-2405d661eec3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c11592ea-4e5f-43ec-874d-2405d661eec3', 'volume_size': 1} Apr 10 10:39:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:53 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-289092931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c11592ea-4e5f-43ec-874d-2405d661eec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa770f15210f4eabbda91dd1cd3eb2b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:53Z,use_quota=True,user_id='2b5d468127fe4700b9eed0ba7cc1c590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:39:53 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] Creating volume c11592ea-4e5f-43ec-874d-2405d661eec3 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:39:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:53 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:53 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:53 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:53 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:39:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:53 devstack sudo[88434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3 1073741824 Apr 10 10:39:53 devstack sudo[88434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:53 devstack sudo[88434]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3 1073741824" returned: 0 in 0.525s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:53 devstack sudo[88439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3 Apr 10 10:39:53 devstack sudo[88439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:54 devstack sudo[88439]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3" returned: 0 in 0.472s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:54 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:39:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:54 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1980da7-9a04-405c-9f40-7f269a1b29ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c11592ea-4e5f-43ec-874d-2405d661eec3', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:54 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a05163d-2772-4956-a4d7-5abd38c25957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:54 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] Volume volume-c11592ea-4e5f-43ec-874d-2405d661eec3 (c11592ea-4e5f-43ec-874d-2405d661eec3): created successfully Apr 10 10:39:54 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a05163d-2772-4956-a4d7-5abd38c25957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:54 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] Flow 'volume_create_manager' (3b169de0-3050-4b25-81f8-2e6dc3559cd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:54 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-8c396a1d-7946-4c22-ad03-99c3b1655536 tempest-VolumesSnapshotTestJSON-425060456 None] Created volume successfully. Apr 10 10:39:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-084df2d2-fe42-4299-bf3f-503858045db7 tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-084df2d2-fe42-4299-bf3f-503858045db7 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:55 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-084df2d2-fe42-4299-bf3f-503858045db7 tempest-VolumesSnapshotTestJSON-425060456 None] Creating offline snapshot 4c715094-19ed-4a5a-bde1-114d5a4cf060 of volume c11592ea-4e5f-43ec-874d-2405d661eec3 {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:39:55 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[126b416e-32cb-4b10-87eb-18181ce19e79]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-084df2d2-fe42-4299-bf3f-503858045db7 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:55 devstack sudo[88443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3 Apr 10 10:39:55 devstack sudo[88443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:56 devstack sudo[88443]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-084df2d2-fe42-4299-bf3f-503858045db7 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3" returned: 0 in 0.580s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-084df2d2-fe42-4299-bf3f-503858045db7 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3.4c715094-19ed-4a5a-bde1-114d5a4cf060 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:56 devstack sudo[88448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3.4c715094-19ed-4a5a-bde1-114d5a4cf060 1G Apr 10 10:39:56 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:56 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-084df2d2-fe42-4299-bf3f-503858045db7 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3.4c715094-19ed-4a5a-bde1-114d5a4cf060 1G" returned: 0 in 0.522s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-084df2d2-fe42-4299-bf3f-503858045db7 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c11592ea-4e5f-43ec-874d-2405d661eec3 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3.4c715094-19ed-4a5a-bde1-114d5a4cf060 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:56 devstack sudo[88453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c11592ea-4e5f-43ec-874d-2405d661eec3 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3.4c715094-19ed-4a5a-bde1-114d5a4cf060 Apr 10 10:39:56 devstack sudo[88453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:57 devstack sudo[88453]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-084df2d2-fe42-4299-bf3f-503858045db7 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c11592ea-4e5f-43ec-874d-2405d661eec3 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3.4c715094-19ed-4a5a-bde1-114d5a4cf060" returned: 0 in 0.450s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:57 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-084df2d2-fe42-4299-bf3f-503858045db7 tempest-VolumesSnapshotTestJSON-425060456 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3.4c715094-19ed-4a5a-bde1-114d5a4cf060 is being set with open permissions: ugo+rw Apr 10 10:39:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-084df2d2-fe42-4299-bf3f-503858045db7 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3.4c715094-19ed-4a5a-bde1-114d5a4cf060 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:57 devstack sudo[88458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3.4c715094-19ed-4a5a-bde1-114d5a4cf060 Apr 10 10:39:57 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:57 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-084df2d2-fe42-4299-bf3f-503858045db7 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3.4c715094-19ed-4a5a-bde1-114d5a4cf060" returned: 0 in 0.416s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-084df2d2-fe42-4299-bf3f-503858045db7 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:57 devstack sudo[88461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3.info Apr 10 10:39:57 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:58 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-084df2d2-fe42-4299-bf3f-503858045db7 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3.info" returned: 0 in 0.434s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:58 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-084df2d2-fe42-4299-bf3f-503858045db7 tempest-VolumesSnapshotTestJSON-425060456 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3.info is being set with open permissions: ugo+rw Apr 10 10:39:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-084df2d2-fe42-4299-bf3f-503858045db7 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:58 devstack sudo[88498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3.info Apr 10 10:39:58 devstack sudo[88498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:58 devstack sudo[88498]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-084df2d2-fe42-4299-bf3f-503858045db7 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3.info" returned: 0 in 0.420s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-084df2d2-fe42-4299-bf3f-503858045db7 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.894s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:58 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-084df2d2-fe42-4299-bf3f-503858045db7 tempest-VolumesSnapshotTestJSON-425060456 None] Create snapshot completed successfully Apr 10 10:39:58 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Flow 'volume_create_manager' (feab615f-f065-4f94-b016-3c5971f58a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6214957e-3c8d-43ad-8abd-3c568f767547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6214957e-3c8d-43ad-8abd-3c568f767547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1798218707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ad5bcce-d388-4435-9776-b5499bb0464e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa770f15210f4eabbda91dd1cd3eb2b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4c715094-19ed-4a5a-bde1-114d5a4cf060,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:59Z,use_quota=True,user_id='2b5d468127fe4700b9eed0ba7cc1c590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8083f96d-3d3f-4f40-9e17-9fe59d69a56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8083f96d-3d3f-4f40-9e17-9fe59d69a56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1692900b-67a7-4976-bdb2-1bee64f98382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1692900b-67a7-4976-bdb2-1bee64f98382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5ad5bcce-d388-4435-9776-b5499bb0464e', 'volume_name': 'volume-5ad5bcce-d388-4435-9776-b5499bb0464e', 'volume_size': 1, 'snapshot_id': '4c715094-19ed-4a5a-bde1-114d5a4cf060'}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (629ca443-411b-4f42-a120-b3c703372ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (629ca443-411b-4f42-a120-b3c703372ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee31984e-bf3e-4a7d-9f75-78d8fe22056b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:59 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Volume 5ad5bcce-d388-4435-9776-b5499bb0464e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5ad5bcce-d388-4435-9776-b5499bb0464e', 'volume_size': 1, 'snapshot_id': '4c715094-19ed-4a5a-bde1-114d5a4cf060'} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "cinder-quobyte-4c715094-19ed-4a5a-bde1-114d5a4cf060-5ad5bcce-d388-4435-9776-b5499bb0464e" by "_create_volume_from_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-quobyte-4c715094-19ed-4a5a-bde1-114d5a4cf060-5ad5bcce-d388-4435-9776-b5499bb0464e" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Creating volume 5ad5bcce-d388-4435-9776-b5499bb0464e from snapshot 4c715094-19ed-4a5a-bde1-114d5a4cf060 {{(pid=81938) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "cinder-quobyte-5ad5bcce-d388-4435-9776-b5499bb0464e" by "_copy_volume_from_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-quobyte-5ad5bcce-d388-4435-9776-b5499bb0464e" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] snapshot: 4c715094-19ed-4a5a-bde1-114d5a4cf060, volume: 5ad5bcce-d388-4435-9776-b5499bb0464e, {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[740cb815-79fd-4077-83dd-73976acee3a7]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3.4c715094-19ed-4a5a-bde1-114d5a4cf060 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:59 devstack sudo[88501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3.4c715094-19ed-4a5a-bde1-114d5a4cf060 Apr 10 10:39:59 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:59 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3.4c715094-19ed-4a5a-bde1-114d5a4cf060" returned: 0 in 0.531s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c11592ea-4e5f-43ec-874d-2405d661eec3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3 {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Creating direct copy from snapshot {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd68197f-ce02-4103-b1ba-0b2903e90ecf]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:59 devstack sudo[88506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3 Apr 10 10:39:59 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:00 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3" returned: 0 in 0.541s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:00 devstack cinder-volume[81938]: DEBUG cinder.utils [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Path /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5ad5bcce-d388-4435-9776-b5499bb0464e not found in is_blk_device check {{(pid=81938) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:40:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5ad5bcce-d388-4435-9776-b5499bb0464e {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:00 devstack sudo[88512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5ad5bcce-d388-4435-9776-b5499bb0464e Apr 10 10:40:00 devstack sudo[88512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:02 devstack sudo[88512]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5ad5bcce-d388-4435-9776-b5499bb0464e" returned: 0 in 2.028s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:02 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed6169b-02d4-4d98-8802-f73d14ca2a28]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:02 devstack sudo[88524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3 Apr 10 10:40:02 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:02 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3" returned: 0 in 0.608s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:02 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3, size 1024.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5ad5bcce-d388-4435-9776-b5499bb0464e {{(pid=81938) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:40:02 devstack cinder-volume[81938]: INFO cinder.image.image_utils [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Converted 1024.00 MB image at 504.73 MB/s Apr 10 10:40:02 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5ad5bcce-d388-4435-9776-b5499bb0464e is being set with open permissions: ugo+rw Apr 10 10:40:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5ad5bcce-d388-4435-9776-b5499bb0464e {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:02 devstack sudo[88529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5ad5bcce-d388-4435-9776-b5499bb0464e Apr 10 10:40:02 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:03 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5ad5bcce-d388-4435-9776-b5499bb0464e" returned: 0 in 0.422s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:03 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-quobyte-5ad5bcce-d388-4435-9776-b5499bb0464e" released by "_copy_volume_from_snapshot" :: held 4.192s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:03 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-quobyte-4c715094-19ed-4a5a-bde1-114d5a4cf060-5ad5bcce-d388-4435-9776-b5499bb0464e" released by "_create_volume_from_snapshot" :: held 4.210s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.219s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:03 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee31984e-bf3e-4a7d-9f75-78d8fe22056b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ad5bcce-d388-4435-9776-b5499bb0464e', 'volume_size': 1, 'snapshot_id': '4c715094-19ed-4a5a-bde1-114d5a4cf060'}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:03 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5f85a5-4a5c-4c3d-8727-51a883323b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:03 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Volume volume-5ad5bcce-d388-4435-9776-b5499bb0464e (5ad5bcce-d388-4435-9776-b5499bb0464e): created successfully Apr 10 10:40:03 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5f85a5-4a5c-4c3d-8727-51a883323b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:03 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Flow 'volume_create_manager' (feab615f-f065-4f94-b016-3c5971f58a94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:03 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-7f7af596-30f5-4a09-b00a-1d8ac5d23aaf tempest-VolumesSnapshotTestJSON-425060456 None] Created volume successfully. Apr 10 10:40:04 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6f17489c-23e6-426c-8e2b-083771b3db1e tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "cinder-5ad5bcce-d388-4435-9776-b5499bb0464e-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:04 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6f17489c-23e6-426c-8e2b-083771b3db1e tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-5ad5bcce-d388-4435-9776-b5499bb0464e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:04 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6f17489c-23e6-426c-8e2b-083771b3db1e tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "cinder-quobyte-5ad5bcce-d388-4435-9776-b5499bb0464e" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:04 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6f17489c-23e6-426c-8e2b-083771b3db1e tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-quobyte-5ad5bcce-d388-4435-9776-b5499bb0464e" acquired by "delete_volume" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:04 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[6100f171-bd0e-4911-ba43-dff6244046f5]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6f17489c-23e6-426c-8e2b-083771b3db1e tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5ad5bcce-d388-4435-9776-b5499bb0464e {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:04 devstack sudo[88532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5ad5bcce-d388-4435-9776-b5499bb0464e Apr 10 10:40:04 devstack sudo[88532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:04 devstack sudo[88532]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6f17489c-23e6-426c-8e2b-083771b3db1e tempest-VolumesSnapshotTestJSON-425060456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5ad5bcce-d388-4435-9776-b5499bb0464e" returned: 0 in 0.524s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6f17489c-23e6-426c-8e2b-083771b3db1e tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5ad5bcce-d388-4435-9776-b5499bb0464e {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:04 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5ad5bcce-d388-4435-9776-b5499bb0464e Apr 10 10:40:04 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:05 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6f17489c-23e6-426c-8e2b-083771b3db1e tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5ad5bcce-d388-4435-9776-b5499bb0464e" returned: 0 in 0.424s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:05 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6f17489c-23e6-426c-8e2b-083771b3db1e tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-quobyte-5ad5bcce-d388-4435-9776-b5499bb0464e" released by "delete_volume" :: held 0.976s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:05 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-6f17489c-23e6-426c-8e2b-083771b3db1e tempest-VolumesSnapshotTestJSON-425060456 None] Created reservations ['783e5404-aac3-4875-b5f4-b9a7bb1ab3b2', '39df9570-16f6-4ea7-8f67-cc429160c3e2', '23abfdc8-8158-4c80-94de-e45c06b3c864', '659f94d2-4cdb-456f-9e67-b795fcdca82f'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6f17489c-23e6-426c-8e2b-083771b3db1e tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6f17489c-23e6-426c-8e2b-083771b3db1e tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:05 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6f17489c-23e6-426c-8e2b-083771b3db1e tempest-VolumesSnapshotTestJSON-425060456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:05 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-6f17489c-23e6-426c-8e2b-083771b3db1e tempest-VolumesSnapshotTestJSON-425060456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-6f17489c-23e6-426c-8e2b-083771b3db1e tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6f17489c-23e6-426c-8e2b-083771b3db1e tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:05 devstack sudo[88540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:40:05 devstack sudo[88540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:05 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-fd90f96c-1f9e-4c2e-b7d4-3bf32ce240f4 tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "cinder-4c715094-19ed-4a5a-bde1-114d5a4cf060-delete_snapshot" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:05 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-fd90f96c-1f9e-4c2e-b7d4-3bf32ce240f4 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-4c715094-19ed-4a5a-bde1-114d5a4cf060-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:05 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-fd90f96c-1f9e-4c2e-b7d4-3bf32ce240f4 tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "cinder-quobyte-c11592ea-4e5f-43ec-874d-2405d661eec3" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:05 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-fd90f96c-1f9e-4c2e-b7d4-3bf32ce240f4 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-quobyte-c11592ea-4e5f-43ec-874d-2405d661eec3" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:05 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-fd90f96c-1f9e-4c2e-b7d4-3bf32ce240f4 tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "cinder-quobyte-4c715094-19ed-4a5a-bde1-114d5a4cf060" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:05 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-fd90f96c-1f9e-4c2e-b7d4-3bf32ce240f4 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-quobyte-4c715094-19ed-4a5a-bde1-114d5a4cf060" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:05 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-fd90f96c-1f9e-4c2e-b7d4-3bf32ce240f4 tempest-VolumesSnapshotTestJSON-425060456 None] Deleting offline snapshot 4c715094-19ed-4a5a-bde1-114d5a4cf060 of volume c11592ea-4e5f-43ec-874d-2405d661eec3 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:40:05 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-fd90f96c-1f9e-4c2e-b7d4-3bf32ce240f4 tempest-VolumesSnapshotTestJSON-425060456 None] snapshot_file for this snap is: volume-c11592ea-4e5f-43ec-874d-2405d661eec3.4c715094-19ed-4a5a-bde1-114d5a4cf060 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:40:05 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[f906a91f-5663-4401-83e9-3f39b75ae4af]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd90f96c-1f9e-4c2e-b7d4-3bf32ce240f4 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3.4c715094-19ed-4a5a-bde1-114d5a4cf060 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:05 devstack sudo[88542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3.4c715094-19ed-4a5a-bde1-114d5a4cf060 Apr 10 10:40:05 devstack sudo[88542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:05 devstack sudo[88540]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6f17489c-23e6-426c-8e2b-083771b3db1e tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.437s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:05 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-6f17489c-23e6-426c-8e2b-083771b3db1e tempest-VolumesSnapshotTestJSON-425060456 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:40:05 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-6f17489c-23e6-426c-8e2b-083771b3db1e tempest-VolumesSnapshotTestJSON-425060456 None] Deleted volume successfully. Apr 10 10:40:05 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6f17489c-23e6-426c-8e2b-083771b3db1e tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-5ad5bcce-d388-4435-9776-b5499bb0464e-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:06 devstack sudo[88542]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd90f96c-1f9e-4c2e-b7d4-3bf32ce240f4 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3.4c715094-19ed-4a5a-bde1-114d5a4cf060" returned: 0 in 0.533s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:06 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-fd90f96c-1f9e-4c2e-b7d4-3bf32ce240f4 tempest-VolumesSnapshotTestJSON-425060456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c11592ea-4e5f-43ec-874d-2405d661eec3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:40:06 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ea86d6-14dd-4061-a15f-bfddd636b2ed]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd90f96c-1f9e-4c2e-b7d4-3bf32ce240f4 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:06 devstack sudo[88548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3 Apr 10 10:40:06 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:06 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd90f96c-1f9e-4c2e-b7d4-3bf32ce240f4 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3" returned: 0 in 0.543s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd90f96c-1f9e-4c2e-b7d4-3bf32ce240f4 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3.4c715094-19ed-4a5a-bde1-114d5a4cf060 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:06 devstack sudo[88553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3.4c715094-19ed-4a5a-bde1-114d5a4cf060 Apr 10 10:40:06 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:07 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd90f96c-1f9e-4c2e-b7d4-3bf32ce240f4 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3.4c715094-19ed-4a5a-bde1-114d5a4cf060" returned: 0 in 0.496s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd90f96c-1f9e-4c2e-b7d4-3bf32ce240f4 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3.4c715094-19ed-4a5a-bde1-114d5a4cf060 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:07 devstack sudo[88558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3.4c715094-19ed-4a5a-bde1-114d5a4cf060 Apr 10 10:40:07 devstack sudo[88558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:07 devstack sudo[88558]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-fd90f96c-1f9e-4c2e-b7d4-3bf32ce240f4 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3.4c715094-19ed-4a5a-bde1-114d5a4cf060" returned: 0 in 0.443s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:07 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-fd90f96c-1f9e-4c2e-b7d4-3bf32ce240f4 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-quobyte-4c715094-19ed-4a5a-bde1-114d5a4cf060" released by "_delete_snapshot" :: held 2.080s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:07 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-fd90f96c-1f9e-4c2e-b7d4-3bf32ce240f4 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-quobyte-c11592ea-4e5f-43ec-874d-2405d661eec3" released by "delete_snapshot" :: held 2.093s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:07 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-fd90f96c-1f9e-4c2e-b7d4-3bf32ce240f4 tempest-VolumesSnapshotTestJSON-425060456 None] Created reservations ['1b9c6053-f07c-40f9-9d24-d63d3472685e', 'dc6ef60f-647a-4f19-a6b6-25fccc4cbdab', '044715fe-ce86-42d2-8394-0962dd6c2ffe', 'f5cdc6fd-e276-43fb-8559-63a69bd2634e'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:07 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-fd90f96c-1f9e-4c2e-b7d4-3bf32ce240f4 tempest-VolumesSnapshotTestJSON-425060456 None] Delete snapshot completed successfully. Apr 10 10:40:07 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-fd90f96c-1f9e-4c2e-b7d4-3bf32ce240f4 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-4c715094-19ed-4a5a-bde1-114d5a4cf060-delete_snapshot" released by "delete_snapshot" :: held 2.192s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:08 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-bf7fee4d-2e0a-41a9-9c74-bd47eb56e951 tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "cinder-c11592ea-4e5f-43ec-874d-2405d661eec3-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:08 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-bf7fee4d-2e0a-41a9-9c74-bd47eb56e951 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-c11592ea-4e5f-43ec-874d-2405d661eec3-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:08 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-bf7fee4d-2e0a-41a9-9c74-bd47eb56e951 tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "cinder-quobyte-c11592ea-4e5f-43ec-874d-2405d661eec3" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:08 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-bf7fee4d-2e0a-41a9-9c74-bd47eb56e951 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-quobyte-c11592ea-4e5f-43ec-874d-2405d661eec3" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:08 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd70d05-ecab-4572-8f7b-a9865331ebba]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bf7fee4d-2e0a-41a9-9c74-bd47eb56e951 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:08 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3 Apr 10 10:40:08 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:09 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bf7fee4d-2e0a-41a9-9c74-bd47eb56e951 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3" returned: 0 in 0.557s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bf7fee4d-2e0a-41a9-9c74-bd47eb56e951 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:09 devstack sudo[88566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3 Apr 10 10:40:09 devstack sudo[88566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:09 devstack sudo[88566]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bf7fee4d-2e0a-41a9-9c74-bd47eb56e951 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c11592ea-4e5f-43ec-874d-2405d661eec3" returned: 0 in 0.507s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:09 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-bf7fee4d-2e0a-41a9-9c74-bd47eb56e951 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-quobyte-c11592ea-4e5f-43ec-874d-2405d661eec3" released by "delete_volume" :: held 1.100s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:09 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-bf7fee4d-2e0a-41a9-9c74-bd47eb56e951 tempest-VolumesSnapshotTestJSON-425060456 None] Created reservations ['0871328d-217b-4b79-8d3d-a0429d6ebf94', '62901f18-7d1e-4ea8-99ea-a655b33b7cbb', '5d4b2bf0-f84e-4754-a913-daecfbff70a3', '5417c561-fe21-481a-bac5-003b93314a43'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-bf7fee4d-2e0a-41a9-9c74-bd47eb56e951 tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-bf7fee4d-2e0a-41a9-9c74-bd47eb56e951 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:10 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-bf7fee4d-2e0a-41a9-9c74-bd47eb56e951 tempest-VolumesSnapshotTestJSON-425060456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:10 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-bf7fee4d-2e0a-41a9-9c74-bd47eb56e951 tempest-VolumesSnapshotTestJSON-425060456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-bf7fee4d-2e0a-41a9-9c74-bd47eb56e951 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bf7fee4d-2e0a-41a9-9c74-bd47eb56e951 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:10 devstack sudo[88570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:40:10 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:10 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-bf7fee4d-2e0a-41a9-9c74-bd47eb56e951 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.486s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:10 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-bf7fee4d-2e0a-41a9-9c74-bd47eb56e951 tempest-VolumesSnapshotTestJSON-425060456 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:40:10 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-bf7fee4d-2e0a-41a9-9c74-bd47eb56e951 tempest-VolumesSnapshotTestJSON-425060456 None] Deleted volume successfully. Apr 10 10:40:10 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-bf7fee4d-2e0a-41a9-9c74-bd47eb56e951 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-c11592ea-4e5f-43ec-874d-2405d661eec3-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:11 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-10e36776-1020-41b9-bb41-bf3989c7cc08 tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "cinder-2096d6ec-9303-4ed9-a985-6f5bdcd5a202-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:11 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-10e36776-1020-41b9-bb41-bf3989c7cc08 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-2096d6ec-9303-4ed9-a985-6f5bdcd5a202-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:11 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-10e36776-1020-41b9-bb41-bf3989c7cc08 tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "cinder-quobyte-2096d6ec-9303-4ed9-a985-6f5bdcd5a202" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:11 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-10e36776-1020-41b9-bb41-bf3989c7cc08 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-quobyte-2096d6ec-9303-4ed9-a985-6f5bdcd5a202" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:11 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89781ab-3c0b-41b0-88b6-b137aab8faea]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-10e36776-1020-41b9-bb41-bf3989c7cc08 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:11 devstack sudo[88573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202 Apr 10 10:40:11 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:11 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-10e36776-1020-41b9-bb41-bf3989c7cc08 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202" returned: 0 in 0.492s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-10e36776-1020-41b9-bb41-bf3989c7cc08 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:11 devstack sudo[88578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202 Apr 10 10:40:11 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:12 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-10e36776-1020-41b9-bb41-bf3989c7cc08 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-2096d6ec-9303-4ed9-a985-6f5bdcd5a202" returned: 0 in 0.444s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:12 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-10e36776-1020-41b9-bb41-bf3989c7cc08 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-quobyte-2096d6ec-9303-4ed9-a985-6f5bdcd5a202" released by "delete_volume" :: held 0.969s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:12 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-10e36776-1020-41b9-bb41-bf3989c7cc08 tempest-VolumesSnapshotTestJSON-425060456 None] Created reservations ['f018c4bb-7794-44f4-8bfe-9715f5f83e9b', '98669d67-ee72-48dc-a704-0d5a611dd719', 'cd3c777f-4788-4b20-abe7-ee3c319d8a01', 'e1aa2466-7ef5-4622-bec8-a024101748dc'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-10e36776-1020-41b9-bb41-bf3989c7cc08 tempest-VolumesSnapshotTestJSON-425060456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-10e36776-1020-41b9-bb41-bf3989c7cc08 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:12 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-10e36776-1020-41b9-bb41-bf3989c7cc08 tempest-VolumesSnapshotTestJSON-425060456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:12 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-10e36776-1020-41b9-bb41-bf3989c7cc08 tempest-VolumesSnapshotTestJSON-425060456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-10e36776-1020-41b9-bb41-bf3989c7cc08 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-10e36776-1020-41b9-bb41-bf3989c7cc08 tempest-VolumesSnapshotTestJSON-425060456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:12 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:40:12 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:12 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-10e36776-1020-41b9-bb41-bf3989c7cc08 tempest-VolumesSnapshotTestJSON-425060456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.442s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:12 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-10e36776-1020-41b9-bb41-bf3989c7cc08 tempest-VolumesSnapshotTestJSON-425060456 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:40:12 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-10e36776-1020-41b9-bb41-bf3989c7cc08 tempest-VolumesSnapshotTestJSON-425060456 None] Deleted volume successfully. Apr 10 10:40:12 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-10e36776-1020-41b9-bb41-bf3989c7cc08 tempest-VolumesSnapshotTestJSON-425060456 None] Lock "cinder-2096d6ec-9303-4ed9-a985-6f5bdcd5a202-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:16 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:16 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Flow 'volume_create_manager' (6e96c797-52ff-4a33-9c7a-0b221182a08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:16 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa6836cd-3253-43ca-a0de-0b905e0950db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:16 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa6836cd-3253-43ca-a0de-0b905e0950db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2057888664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='444b67fbd5654593b9d0535462ce0e8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:16Z,use_quota=True,user_id='90d4a233e8e84b71a13718a575ddac8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:16 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c0b11e-97e6-4ddd-b85f-172b712fc852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:16 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c0b11e-97e6-4ddd-b85f-172b712fc852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:16 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09394353-e424-4c13-8ba8-47b460423612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:16 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09394353-e424-4c13-8ba8-47b460423612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2', 'volume_name': 'volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2', 'volume_size': 2}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:16 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef3a21c5-fb05-433f-8cca-0a969d8a11e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:16 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef3a21c5-fb05-433f-8cca-0a969d8a11e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:16 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b35fbdb-14c0-494c-b577-96d22bf03a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:16 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Volume b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2', 'volume_size': 2} Apr 10 10:40:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:16 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2057888664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='444b67fbd5654593b9d0535462ce0e8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:16Z,use_quota=True,user_id='90d4a233e8e84b71a13718a575ddac8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:40:16 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Creating volume b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:40:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:16 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:16 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:16 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:40:16 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:40:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2 2147483648 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:16 devstack sudo[88586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2 2147483648 Apr 10 10:40:16 devstack sudo[88586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:16 devstack sudo[88586]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2 2147483648" returned: 0 in 0.504s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:16 devstack sudo[88591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2 Apr 10 10:40:16 devstack sudo[88591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:17 devstack sudo[88591]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2" returned: 0 in 0.426s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:17 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:40:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:17 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b35fbdb-14c0-494c-b577-96d22bf03a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2', 'volume_size': 2}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:17 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf44d39-f65a-4d8d-8955-3c892b27bf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:17 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Volume volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2 (b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2): created successfully Apr 10 10:40:17 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf44d39-f65a-4d8d-8955-3c892b27bf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:17 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Flow 'volume_create_manager' (6e96c797-52ff-4a33-9c7a-0b221182a08d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:17 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-a4a1fb3b-590f-44f9-a804-b89f568e91c2 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Created volume successfully. Apr 10 10:40:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e8e267c8-a442-4ca7-988d-ec0dae6b4e0b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e8e267c8-a442-4ca7-988d-ec0dae6b4e0b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:18 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-e8e267c8-a442-4ca7-988d-ec0dae6b4e0b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Creating offline snapshot 38f30fef-93d3-4345-898a-5c19213b8fc0 of volume b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2 {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:40:18 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[1440e9fd-02cf-485d-bf11-839a69dea85d]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e8e267c8-a442-4ca7-988d-ec0dae6b4e0b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:18 devstack sudo[88594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2 Apr 10 10:40:18 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:19 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e8e267c8-a442-4ca7-988d-ec0dae6b4e0b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2" returned: 0 in 0.501s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e8e267c8-a442-4ca7-988d-ec0dae6b4e0b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2.38f30fef-93d3-4345-898a-5c19213b8fc0 2G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:19 devstack sudo[88599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2.38f30fef-93d3-4345-898a-5c19213b8fc0 2G Apr 10 10:40:19 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:19 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e8e267c8-a442-4ca7-988d-ec0dae6b4e0b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2.38f30fef-93d3-4345-898a-5c19213b8fc0 2G" returned: 0 in 0.531s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e8e267c8-a442-4ca7-988d-ec0dae6b4e0b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2.38f30fef-93d3-4345-898a-5c19213b8fc0 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:19 devstack sudo[88604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2.38f30fef-93d3-4345-898a-5c19213b8fc0 Apr 10 10:40:19 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:20 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e8e267c8-a442-4ca7-988d-ec0dae6b4e0b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2.38f30fef-93d3-4345-898a-5c19213b8fc0" returned: 0 in 0.462s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:20 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-e8e267c8-a442-4ca7-988d-ec0dae6b4e0b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2.38f30fef-93d3-4345-898a-5c19213b8fc0 is being set with open permissions: ugo+rw Apr 10 10:40:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e8e267c8-a442-4ca7-988d-ec0dae6b4e0b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2.38f30fef-93d3-4345-898a-5c19213b8fc0 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:20 devstack sudo[88610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2.38f30fef-93d3-4345-898a-5c19213b8fc0 Apr 10 10:40:20 devstack sudo[88610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:20 devstack sudo[88610]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e8e267c8-a442-4ca7-988d-ec0dae6b4e0b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2.38f30fef-93d3-4345-898a-5c19213b8fc0" returned: 0 in 0.416s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:20 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writing DB stats cinder:DELETE=15,cinder:SELECT=123,cinder:UPDATE=196,cinder:INSERT=40 {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:40:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e8e267c8-a442-4ca7-988d-ec0dae6b4e0b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:20 devstack sudo[88613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2.info Apr 10 10:40:20 devstack sudo[88613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:21 devstack sudo[88613]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e8e267c8-a442-4ca7-988d-ec0dae6b4e0b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2.info" returned: 0 in 0.483s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:21 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-e8e267c8-a442-4ca7-988d-ec0dae6b4e0b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2.info is being set with open permissions: ugo+rw Apr 10 10:40:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e8e267c8-a442-4ca7-988d-ec0dae6b4e0b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:21 devstack sudo[88616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2.info Apr 10 10:40:21 devstack sudo[88616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:21 devstack sudo[88616]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e8e267c8-a442-4ca7-988d-ec0dae6b4e0b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2.info" returned: 0 in 0.460s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e8e267c8-a442-4ca7-988d-ec0dae6b4e0b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.917s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:21 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-e8e267c8-a442-4ca7-988d-ec0dae6b4e0b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Create snapshot completed successfully Apr 10 10:40:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6d531cb0-8398-416d-9061-fa84d0123df4 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Acquiring lock "cinder-38f30fef-93d3-4345-898a-5c19213b8fc0-delete_snapshot" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6d531cb0-8398-416d-9061-fa84d0123df4 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Lock "cinder-38f30fef-93d3-4345-898a-5c19213b8fc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6d531cb0-8398-416d-9061-fa84d0123df4 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Acquiring lock "cinder-quobyte-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6d531cb0-8398-416d-9061-fa84d0123df4 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Lock "cinder-quobyte-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6d531cb0-8398-416d-9061-fa84d0123df4 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Acquiring lock "cinder-quobyte-38f30fef-93d3-4345-898a-5c19213b8fc0" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6d531cb0-8398-416d-9061-fa84d0123df4 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Lock "cinder-quobyte-38f30fef-93d3-4345-898a-5c19213b8fc0" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:21 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-6d531cb0-8398-416d-9061-fa84d0123df4 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Deleting offline snapshot 38f30fef-93d3-4345-898a-5c19213b8fc0 of volume b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:40:21 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-6d531cb0-8398-416d-9061-fa84d0123df4 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] snapshot_file for this snap is: volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2.38f30fef-93d3-4345-898a-5c19213b8fc0 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:40:21 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff1774c-5af3-4a82-8ebc-8a626be32759]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6d531cb0-8398-416d-9061-fa84d0123df4 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2.38f30fef-93d3-4345-898a-5c19213b8fc0 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:21 devstack sudo[88619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2.38f30fef-93d3-4345-898a-5c19213b8fc0 Apr 10 10:40:21 devstack sudo[88619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:22 devstack sudo[88619]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6d531cb0-8398-416d-9061-fa84d0123df4 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2.38f30fef-93d3-4345-898a-5c19213b8fc0" returned: 0 in 0.513s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-6d531cb0-8398-416d-9061-fa84d0123df4 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:40:22 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f4985d-7a4a-4225-bda0-414d27d09d2c]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6d531cb0-8398-416d-9061-fa84d0123df4 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:22 devstack sudo[88624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2 Apr 10 10:40:22 devstack sudo[88624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:22 devstack sudo[88624]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6d531cb0-8398-416d-9061-fa84d0123df4 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2" returned: 0 in 0.523s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6d531cb0-8398-416d-9061-fa84d0123df4 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2.38f30fef-93d3-4345-898a-5c19213b8fc0 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:22 devstack sudo[88630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2.38f30fef-93d3-4345-898a-5c19213b8fc0 Apr 10 10:40:22 devstack sudo[88630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:23 devstack sudo[88630]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6d531cb0-8398-416d-9061-fa84d0123df4 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2.38f30fef-93d3-4345-898a-5c19213b8fc0" returned: 0 in 0.484s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6d531cb0-8398-416d-9061-fa84d0123df4 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2.38f30fef-93d3-4345-898a-5c19213b8fc0 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:23 devstack sudo[88635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2.38f30fef-93d3-4345-898a-5c19213b8fc0 Apr 10 10:40:23 devstack sudo[88635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:23 devstack sudo[88635]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6d531cb0-8398-416d-9061-fa84d0123df4 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2.38f30fef-93d3-4345-898a-5c19213b8fc0" returned: 0 in 0.433s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:23 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6d531cb0-8398-416d-9061-fa84d0123df4 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Lock "cinder-quobyte-38f30fef-93d3-4345-898a-5c19213b8fc0" released by "_delete_snapshot" :: held 2.011s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:23 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6d531cb0-8398-416d-9061-fa84d0123df4 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Lock "cinder-quobyte-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2" released by "delete_snapshot" :: held 2.023s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:23 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-6d531cb0-8398-416d-9061-fa84d0123df4 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Created reservations ['821e8b3f-8821-49de-8966-ac4f92ada1d5', '748181ef-62a5-4215-8762-69c8a61623d9', 'c9a00e48-5ee0-4378-9d50-221e3729ced2', 'ebc858f4-7d1d-46b7-b0c7-2142847a85ed'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:23 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-6d531cb0-8398-416d-9061-fa84d0123df4 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Delete snapshot completed successfully. Apr 10 10:40:23 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6d531cb0-8398-416d-9061-fa84d0123df4 tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Lock "cinder-38f30fef-93d3-4345-898a-5c19213b8fc0-delete_snapshot" released by "delete_snapshot" :: held 2.118s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:24 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cf44237d-a3ac-4571-b222-cc5baa2bd26b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Acquiring lock "cinder-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:24 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cf44237d-a3ac-4571-b222-cc5baa2bd26b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Lock "cinder-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cf44237d-a3ac-4571-b222-cc5baa2bd26b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Acquiring lock "cinder-quobyte-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cf44237d-a3ac-4571-b222-cc5baa2bd26b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Lock "cinder-quobyte-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2" acquired by "delete_volume" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:25 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cbaeba-6f75-47cc-849f-33fe72d75897]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cf44237d-a3ac-4571-b222-cc5baa2bd26b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:25 devstack sudo[88638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2 Apr 10 10:40:25 devstack sudo[88638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:25 devstack sudo[88638]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cf44237d-a3ac-4571-b222-cc5baa2bd26b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2" returned: 0 in 0.498s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cf44237d-a3ac-4571-b222-cc5baa2bd26b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:25 devstack sudo[88643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2 Apr 10 10:40:25 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:25 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cf44237d-a3ac-4571-b222-cc5baa2bd26b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2" returned: 0 in 0.436s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cf44237d-a3ac-4571-b222-cc5baa2bd26b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Lock "cinder-quobyte-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2" released by "delete_volume" :: held 0.975s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:26 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-cf44237d-a3ac-4571-b222-cc5baa2bd26b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Created reservations ['275ad05c-b824-49df-98f5-ad83b835f095', '0f4a1589-ae4b-445d-b4f4-9d7bc34fd353', 'dec913c5-ac5a-4238-884a-e456c0bbfdfa', '6c438301-f62b-42aa-80ad-d21e7fd21733'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-cf44237d-a3ac-4571-b222-cc5baa2bd26b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-cf44237d-a3ac-4571-b222-cc5baa2bd26b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:26 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-cf44237d-a3ac-4571-b222-cc5baa2bd26b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:26 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-cf44237d-a3ac-4571-b222-cc5baa2bd26b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-cf44237d-a3ac-4571-b222-cc5baa2bd26b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cf44237d-a3ac-4571-b222-cc5baa2bd26b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:26 devstack sudo[88646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:40:26 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:26 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cf44237d-a3ac-4571-b222-cc5baa2bd26b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.432s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:26 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-cf44237d-a3ac-4571-b222-cc5baa2bd26b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:40:26 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-cf44237d-a3ac-4571-b222-cc5baa2bd26b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Deleted volume successfully. Apr 10 10:40:26 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cf44237d-a3ac-4571-b222-cc5baa2bd26b tempest-VolumesSnapshotNegativeTestJSON-677701689 None] Lock "cinder-b550bf0f-0bfc-4b8c-9f9c-f9966dfc54f2-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:28 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:28 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] Flow 'volume_create_manager' (f6b7002d-6d98-47e0-a077-ffd071121590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:28 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40cbf4bb-c3a5-4440-9185-e7db3794ebd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40cbf4bb-c3a5-4440-9185-e7db3794ebd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1460133922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61218107-6fe9-4260-86d6-c26f1f620e3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40677e25e0a248d499b2652960b87a79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:29Z,use_quota=True,user_id='8afcaa0782604789b159729d89c30136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b922862-021f-466e-883d-7a1e444110fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b922862-021f-466e-883d-7a1e444110fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb5242f6-8e57-4fdd-9895-365082f8b950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb5242f6-8e57-4fdd-9895-365082f8b950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61218107-6fe9-4260-86d6-c26f1f620e3e', 'volume_name': 'volume-61218107-6fe9-4260-86d6-c26f1f620e3e', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e4afc0a-0e9b-4a7c-85f9-9c617904e936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e4afc0a-0e9b-4a7c-85f9-9c617904e936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a84573-7ccf-4fbb-996b-84bbd1427d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:29 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] Volume 61218107-6fe9-4260-86d6-c26f1f620e3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61218107-6fe9-4260-86d6-c26f1f620e3e', 'volume_size': 1} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1460133922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61218107-6fe9-4260-86d6-c26f1f620e3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40677e25e0a248d499b2652960b87a79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:29Z,use_quota=True,user_id='8afcaa0782604789b159729d89c30136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] Creating volume 61218107-6fe9-4260-86d6-c26f1f620e3e {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:40:29 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-61218107-6fe9-4260-86d6-c26f1f620e3e 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:29 devstack sudo[88650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-61218107-6fe9-4260-86d6-c26f1f620e3e 1073741824 Apr 10 10:40:29 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] Flow 'volume_create_manager' (4477fb79-3449-4644-949f-e98446014cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ad5823-9696-44f8-a9fe-60b20f77152f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ad5823-9696-44f8-a9fe-60b20f77152f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1259013721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73907698-8c13-4ff7-a0ed-4d08327b0435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40677e25e0a248d499b2652960b87a79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:29Z,use_quota=True,user_id='8afcaa0782604789b159729d89c30136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7701a5-b829-473b-a65e-f5b1e246c2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7701a5-b829-473b-a65e-f5b1e246c2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f3befc-017c-44f4-b664-817ddf75ca13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f3befc-017c-44f4-b664-817ddf75ca13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73907698-8c13-4ff7-a0ed-4d08327b0435', 'volume_name': 'volume-73907698-8c13-4ff7-a0ed-4d08327b0435', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db7b66ab-1c3d-40d0-92b0-250f3cc938a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db7b66ab-1c3d-40d0-92b0-250f3cc938a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f7e6336-93a2-4fc7-8aab-53a0e8e2485d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:29 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] Volume 73907698-8c13-4ff7-a0ed-4d08327b0435: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73907698-8c13-4ff7-a0ed-4d08327b0435', 'volume_size': 1} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] Flow 'volume_create_manager' (40f91f2e-9a39-41f4-a188-56065ca7a14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe8fb317-3251-4955-84b7-ef942f4edf59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe8fb317-3251-4955-84b7-ef942f4edf59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-924666543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ace4815d-0111-413c-99e5-bde62080dcde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40677e25e0a248d499b2652960b87a79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:29Z,use_quota=True,user_id='8afcaa0782604789b159729d89c30136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d169f12b-9e9f-43cd-ba16-94d2e761ba9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d169f12b-9e9f-43cd-ba16-94d2e761ba9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e72fa0-33bd-4eac-a432-47fc01a2aa08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e72fa0-33bd-4eac-a432-47fc01a2aa08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ace4815d-0111-413c-99e5-bde62080dcde', 'volume_name': 'volume-ace4815d-0111-413c-99e5-bde62080dcde', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dab126fd-171c-4a7e-8b6d-abd9fc4e8a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dab126fd-171c-4a7e-8b6d-abd9fc4e8a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c840651a-dd0f-4b69-be32-b11a459e43c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:29 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] Volume ace4815d-0111-413c-99e5-bde62080dcde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ace4815d-0111-413c-99e5-bde62080dcde', 'volume_size': 1} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:29 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] Flow 'volume_create_manager' (b75e264e-62e4-41ee-999f-d8163044c8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bd5fb53-7fb0-4be2-9347-48196577356d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bd5fb53-7fb0-4be2-9347-48196577356d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-900649463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=356d7f51-3e2f-4617-a864-c6348573a4ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40677e25e0a248d499b2652960b87a79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:30Z,use_quota=True,user_id='8afcaa0782604789b159729d89c30136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3db27b5-22d4-4899-ba41-ec70029f334a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3db27b5-22d4-4899-ba41-ec70029f334a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900d4ac7-79ba-477f-86ca-0a69e514d9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900d4ac7-79ba-477f-86ca-0a69e514d9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '356d7f51-3e2f-4617-a864-c6348573a4ad', 'volume_name': 'volume-356d7f51-3e2f-4617-a864-c6348573a4ad', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75307597-a4cb-43a3-9bb6-4022673921e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75307597-a4cb-43a3-9bb6-4022673921e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1283e8bb-4d8d-4cad-a762-10a3bd23c39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:29 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] Volume 356d7f51-3e2f-4617-a864-c6348573a4ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-356d7f51-3e2f-4617-a864-c6348573a4ad', 'volume_size': 1} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-61218107-6fe9-4260-86d6-c26f1f620e3e 1073741824" returned: 0 in 0.659s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-61218107-6fe9-4260-86d6-c26f1f620e3e {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:29 devstack sudo[88655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-61218107-6fe9-4260-86d6-c26f1f620e3e Apr 10 10:40:29 devstack sudo[88655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] Flow 'volume_create_manager' (4af8d4f9-4927-4015-8007-5e277a2eb49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e76adca-e9b7-4c98-bc6a-1f003a4bcc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e76adca-e9b7-4c98-bc6a-1f003a4bcc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-613836702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf4d9ae-5514-4769-9949-9c6dd2b5c6f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40677e25e0a248d499b2652960b87a79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:30Z,use_quota=True,user_id='8afcaa0782604789b159729d89c30136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077c0c2d-a06b-4de0-861e-fea85f5034c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077c0c2d-a06b-4de0-861e-fea85f5034c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f900bcfe-f57e-4f40-97a7-35d32c5cbfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f900bcfe-f57e-4f40-97a7-35d32c5cbfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bf4d9ae-5514-4769-9949-9c6dd2b5c6f2', 'volume_name': 'volume-5bf4d9ae-5514-4769-9949-9c6dd2b5c6f2', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55268927-9e0b-45e9-94c4-e125c110a5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55268927-9e0b-45e9-94c4-e125c110a5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1923666d-375f-4d94-9905-8e38fb6bf0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:29 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] Volume 5bf4d9ae-5514-4769-9949-9c6dd2b5c6f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bf4d9ae-5514-4769-9949-9c6dd2b5c6f2', 'volume_size': 1} Apr 10 10:40:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:30 devstack sudo[88655]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-61218107-6fe9-4260-86d6-c26f1f620e3e" returned: 0 in 0.440s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:30 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:40:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.913s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:30 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1259013721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73907698-8c13-4ff7-a0ed-4d08327b0435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40677e25e0a248d499b2652960b87a79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:29Z,use_quota=True,user_id='8afcaa0782604789b159729d89c30136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:40:30 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] Creating volume 73907698-8c13-4ff7-a0ed-4d08327b0435 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:40:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:30 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:30 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:30 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:40:30 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:40:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-73907698-8c13-4ff7-a0ed-4d08327b0435 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:30 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a84573-7ccf-4fbb-996b-84bbd1427d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61218107-6fe9-4260-86d6-c26f1f620e3e', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:30 devstack sudo[88659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-73907698-8c13-4ff7-a0ed-4d08327b0435 1073741824 Apr 10 10:40:30 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eeb8888-b4e3-44dc-b619-d9bb04925978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:30 devstack sudo[88659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:30 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] Volume volume-61218107-6fe9-4260-86d6-c26f1f620e3e (61218107-6fe9-4260-86d6-c26f1f620e3e): created successfully Apr 10 10:40:30 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eeb8888-b4e3-44dc-b619-d9bb04925978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:30 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] Flow 'volume_create_manager' (f6b7002d-6d98-47e0-a077-ffd071121590) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:30 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-0bb2451c-4379-483d-b900-25a65a8ac77a tempest-CreateVolumesFromImageTest-1156132122 None] Created volume successfully. Apr 10 10:40:30 devstack sudo[88659]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-73907698-8c13-4ff7-a0ed-4d08327b0435 1073741824" returned: 0 in 0.486s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-73907698-8c13-4ff7-a0ed-4d08327b0435 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:30 devstack sudo[88664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-73907698-8c13-4ff7-a0ed-4d08327b0435 Apr 10 10:40:30 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:31 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-73907698-8c13-4ff7-a0ed-4d08327b0435" returned: 0 in 0.433s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:31 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:40:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.701s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:31 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-924666543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ace4815d-0111-413c-99e5-bde62080dcde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40677e25e0a248d499b2652960b87a79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:29Z,use_quota=True,user_id='8afcaa0782604789b159729d89c30136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:40:31 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] Creating volume ace4815d-0111-413c-99e5-bde62080dcde {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:40:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:31 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:31 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:31 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:40:31 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:40:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ace4815d-0111-413c-99e5-bde62080dcde 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:31 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f7e6336-93a2-4fc7-8aab-53a0e8e2485d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73907698-8c13-4ff7-a0ed-4d08327b0435', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:31 devstack sudo[88668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ace4815d-0111-413c-99e5-bde62080dcde 1073741824 Apr 10 10:40:31 devstack sudo[88668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:31 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c038bf9-9cd9-445c-99ec-b10ef3dc27b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:31 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] Volume volume-73907698-8c13-4ff7-a0ed-4d08327b0435 (73907698-8c13-4ff7-a0ed-4d08327b0435): created successfully Apr 10 10:40:31 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c038bf9-9cd9-445c-99ec-b10ef3dc27b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:31 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] Flow 'volume_create_manager' (4477fb79-3449-4644-949f-e98446014cd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:31 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-531f1ec5-6848-4a64-b85f-c3c06517dcaf tempest-CreateVolumesFromImageTest-1156132122 None] Created volume successfully. Apr 10 10:40:31 devstack sudo[88668]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ace4815d-0111-413c-99e5-bde62080dcde 1073741824" returned: 0 in 0.498s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ace4815d-0111-413c-99e5-bde62080dcde {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:31 devstack sudo[88674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ace4815d-0111-413c-99e5-bde62080dcde Apr 10 10:40:31 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:32 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ace4815d-0111-413c-99e5-bde62080dcde" returned: 0 in 0.410s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.363s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-900649463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=356d7f51-3e2f-4617-a864-c6348573a4ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40677e25e0a248d499b2652960b87a79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:30Z,use_quota=True,user_id='8afcaa0782604789b159729d89c30136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] Creating volume 356d7f51-3e2f-4617-a864-c6348573a4ad {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:40:32 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-356d7f51-3e2f-4617-a864-c6348573a4ad 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c840651a-dd0f-4b69-be32-b11a459e43c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ace4815d-0111-413c-99e5-bde62080dcde', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:32 devstack sudo[88677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-356d7f51-3e2f-4617-a864-c6348573a4ad 1073741824 Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5532fd7-8f44-4423-87d7-945f5b9d8fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:32 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:32 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] Volume volume-ace4815d-0111-413c-99e5-bde62080dcde (ace4815d-0111-413c-99e5-bde62080dcde): created successfully Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5532fd7-8f44-4423-87d7-945f5b9d8fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] Flow 'volume_create_manager' (40f91f2e-9a39-41f4-a188-56065ca7a14d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:32 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-03d4d841-9aa5-4bd6-b1b3-2a135d10728a tempest-CreateVolumesFromImageTest-1156132122 None] Created volume successfully. Apr 10 10:40:32 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-356d7f51-3e2f-4617-a864-c6348573a4ad 1073741824" returned: 0 in 0.469s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-356d7f51-3e2f-4617-a864-c6348573a4ad {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:32 devstack sudo[88682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-356d7f51-3e2f-4617-a864-c6348573a4ad Apr 10 10:40:32 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:32 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-356d7f51-3e2f-4617-a864-c6348573a4ad" returned: 0 in 0.418s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.057s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-613836702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf4d9ae-5514-4769-9949-9c6dd2b5c6f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40677e25e0a248d499b2652960b87a79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:30Z,use_quota=True,user_id='8afcaa0782604789b159729d89c30136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] Creating volume 5bf4d9ae-5514-4769-9949-9c6dd2b5c6f2 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:40:32 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:40:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5bf4d9ae-5514-4769-9949-9c6dd2b5c6f2 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1283e8bb-4d8d-4cad-a762-10a3bd23c39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-356d7f51-3e2f-4617-a864-c6348573a4ad', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:33 devstack sudo[88685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5bf4d9ae-5514-4769-9949-9c6dd2b5c6f2 1073741824 Apr 10 10:40:33 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8926fd-2b66-4523-83a0-c6a3aeafc68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:33 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] Volume volume-356d7f51-3e2f-4617-a864-c6348573a4ad (356d7f51-3e2f-4617-a864-c6348573a4ad): created successfully Apr 10 10:40:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8926fd-2b66-4523-83a0-c6a3aeafc68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] Flow 'volume_create_manager' (b75e264e-62e4-41ee-999f-d8163044c8bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:33 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-67309571-e4dd-4c9e-9860-714d8fbbd757 tempest-CreateVolumesFromImageTest-1156132122 None] Created volume successfully. Apr 10 10:40:33 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5bf4d9ae-5514-4769-9949-9c6dd2b5c6f2 1073741824" returned: 0 in 0.508s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5bf4d9ae-5514-4769-9949-9c6dd2b5c6f2 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:33 devstack sudo[88690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5bf4d9ae-5514-4769-9949-9c6dd2b5c6f2 Apr 10 10:40:33 devstack sudo[88690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:33 devstack sudo[88690]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5bf4d9ae-5514-4769-9949-9c6dd2b5c6f2" returned: 0 in 0.430s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:33 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:40:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1923666d-375f-4d94-9905-8e38fb6bf0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bf4d9ae-5514-4769-9949-9c6dd2b5c6f2', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83d30f0d-67b7-4c9a-aecd-9d5c1ec22f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:33 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] Volume volume-5bf4d9ae-5514-4769-9949-9c6dd2b5c6f2 (5bf4d9ae-5514-4769-9949-9c6dd2b5c6f2): created successfully Apr 10 10:40:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83d30f0d-67b7-4c9a-aecd-9d5c1ec22f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:33 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] Flow 'volume_create_manager' (4af8d4f9-4927-4015-8007-5e277a2eb49a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:33 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-a15f020a-6e16-40e8-9e4f-4a042a1e77f2 tempest-CreateVolumesFromImageTest-1156132122 None] Created volume successfully. Apr 10 10:40:34 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-81442371-7ac7-4376-aa21-f43e9f7e5be9 tempest-CreateVolumesFromImageTest-1156132122 None] Acquiring lock "cinder-5bf4d9ae-5514-4769-9949-9c6dd2b5c6f2-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:34 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-81442371-7ac7-4376-aa21-f43e9f7e5be9 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "cinder-5bf4d9ae-5514-4769-9949-9c6dd2b5c6f2-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:34 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-81442371-7ac7-4376-aa21-f43e9f7e5be9 tempest-CreateVolumesFromImageTest-1156132122 None] Acquiring lock "cinder-quobyte-5bf4d9ae-5514-4769-9949-9c6dd2b5c6f2" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:34 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-81442371-7ac7-4376-aa21-f43e9f7e5be9 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "cinder-quobyte-5bf4d9ae-5514-4769-9949-9c6dd2b5c6f2" acquired by "delete_volume" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:34 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[438964a5-e21c-4e7e-97fa-edcf04e4e00c]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-81442371-7ac7-4376-aa21-f43e9f7e5be9 tempest-CreateVolumesFromImageTest-1156132122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5bf4d9ae-5514-4769-9949-9c6dd2b5c6f2 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:34 devstack sudo[88693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5bf4d9ae-5514-4769-9949-9c6dd2b5c6f2 Apr 10 10:40:34 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:34 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-81442371-7ac7-4376-aa21-f43e9f7e5be9 tempest-CreateVolumesFromImageTest-1156132122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5bf4d9ae-5514-4769-9949-9c6dd2b5c6f2" returned: 0 in 0.475s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-81442371-7ac7-4376-aa21-f43e9f7e5be9 tempest-CreateVolumesFromImageTest-1156132122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5bf4d9ae-5514-4769-9949-9c6dd2b5c6f2 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:34 devstack sudo[88698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5bf4d9ae-5514-4769-9949-9c6dd2b5c6f2 Apr 10 10:40:34 devstack sudo[88698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:35 devstack sudo[88698]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-81442371-7ac7-4376-aa21-f43e9f7e5be9 tempest-CreateVolumesFromImageTest-1156132122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-5bf4d9ae-5514-4769-9949-9c6dd2b5c6f2" returned: 0 in 0.442s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:35 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-81442371-7ac7-4376-aa21-f43e9f7e5be9 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "cinder-quobyte-5bf4d9ae-5514-4769-9949-9c6dd2b5c6f2" released by "delete_volume" :: held 0.941s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:35 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-81442371-7ac7-4376-aa21-f43e9f7e5be9 tempest-CreateVolumesFromImageTest-1156132122 None] Created reservations ['63d6a960-a4cc-436e-9327-023b45d9c9ef', 'a8015788-d938-4fda-91af-9f22e25bd3b4', '3604cfce-bce9-43c2-8655-51ce956bf95b', '8cac7dea-d50c-4d60-8d2a-ac7a2e659af1'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-81442371-7ac7-4376-aa21-f43e9f7e5be9 tempest-CreateVolumesFromImageTest-1156132122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-81442371-7ac7-4376-aa21-f43e9f7e5be9 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:35 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-81442371-7ac7-4376-aa21-f43e9f7e5be9 tempest-CreateVolumesFromImageTest-1156132122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:35 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-81442371-7ac7-4376-aa21-f43e9f7e5be9 tempest-CreateVolumesFromImageTest-1156132122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-81442371-7ac7-4376-aa21-f43e9f7e5be9 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-81442371-7ac7-4376-aa21-f43e9f7e5be9 tempest-CreateVolumesFromImageTest-1156132122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:35 devstack sudo[88701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:40:35 devstack sudo[88701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:35 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f176a5df-594d-44ba-8788-cfb50d5e6923 tempest-CreateVolumesFromImageTest-1156132122 None] Acquiring lock "cinder-356d7f51-3e2f-4617-a864-c6348573a4ad-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:35 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f176a5df-594d-44ba-8788-cfb50d5e6923 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "cinder-356d7f51-3e2f-4617-a864-c6348573a4ad-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:35 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f176a5df-594d-44ba-8788-cfb50d5e6923 tempest-CreateVolumesFromImageTest-1156132122 None] Acquiring lock "cinder-quobyte-356d7f51-3e2f-4617-a864-c6348573a4ad" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:35 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f176a5df-594d-44ba-8788-cfb50d5e6923 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "cinder-quobyte-356d7f51-3e2f-4617-a864-c6348573a4ad" acquired by "delete_volume" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:35 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a7910b-054f-479b-a6d2-d4365a8193d8]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f176a5df-594d-44ba-8788-cfb50d5e6923 tempest-CreateVolumesFromImageTest-1156132122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-356d7f51-3e2f-4617-a864-c6348573a4ad {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:35 devstack sudo[88703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-356d7f51-3e2f-4617-a864-c6348573a4ad Apr 10 10:40:35 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:35 devstack sudo[88701]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-81442371-7ac7-4376-aa21-f43e9f7e5be9 tempest-CreateVolumesFromImageTest-1156132122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.424s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:35 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-81442371-7ac7-4376-aa21-f43e9f7e5be9 tempest-CreateVolumesFromImageTest-1156132122 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:40:35 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-81442371-7ac7-4376-aa21-f43e9f7e5be9 tempest-CreateVolumesFromImageTest-1156132122 None] Deleted volume successfully. Apr 10 10:40:35 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-81442371-7ac7-4376-aa21-f43e9f7e5be9 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "cinder-5bf4d9ae-5514-4769-9949-9c6dd2b5c6f2-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:35 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f176a5df-594d-44ba-8788-cfb50d5e6923 tempest-CreateVolumesFromImageTest-1156132122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-356d7f51-3e2f-4617-a864-c6348573a4ad" returned: 0 in 0.494s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f176a5df-594d-44ba-8788-cfb50d5e6923 tempest-CreateVolumesFromImageTest-1156132122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-356d7f51-3e2f-4617-a864-c6348573a4ad {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:35 devstack sudo[88709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-356d7f51-3e2f-4617-a864-c6348573a4ad Apr 10 10:40:35 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:36 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f176a5df-594d-44ba-8788-cfb50d5e6923 tempest-CreateVolumesFromImageTest-1156132122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-356d7f51-3e2f-4617-a864-c6348573a4ad" returned: 0 in 0.409s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:36 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f176a5df-594d-44ba-8788-cfb50d5e6923 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "cinder-quobyte-356d7f51-3e2f-4617-a864-c6348573a4ad" released by "delete_volume" :: held 0.927s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:36 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-f176a5df-594d-44ba-8788-cfb50d5e6923 tempest-CreateVolumesFromImageTest-1156132122 None] Created reservations ['86deb159-67be-4a99-b94f-82fb6f231b39', '13f88321-7990-4b2e-868d-e77e882e2a3d', 'ace655ff-67ee-4c13-9b89-67af9e10187c', '2cc06144-8810-4732-8b94-b143024a5c28'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f176a5df-594d-44ba-8788-cfb50d5e6923 tempest-CreateVolumesFromImageTest-1156132122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f176a5df-594d-44ba-8788-cfb50d5e6923 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:36 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f176a5df-594d-44ba-8788-cfb50d5e6923 tempest-CreateVolumesFromImageTest-1156132122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:36 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f176a5df-594d-44ba-8788-cfb50d5e6923 tempest-CreateVolumesFromImageTest-1156132122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f176a5df-594d-44ba-8788-cfb50d5e6923 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f176a5df-594d-44ba-8788-cfb50d5e6923 tempest-CreateVolumesFromImageTest-1156132122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:36 devstack sudo[88712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:40:36 devstack sudo[88712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:36 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-15c94e01-6cb0-4780-ac58-0d96d9d97ceb tempest-CreateVolumesFromImageTest-1156132122 None] Acquiring lock "cinder-ace4815d-0111-413c-99e5-bde62080dcde-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:36 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-15c94e01-6cb0-4780-ac58-0d96d9d97ceb tempest-CreateVolumesFromImageTest-1156132122 None] Lock "cinder-ace4815d-0111-413c-99e5-bde62080dcde-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:36 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-15c94e01-6cb0-4780-ac58-0d96d9d97ceb tempest-CreateVolumesFromImageTest-1156132122 None] Acquiring lock "cinder-quobyte-ace4815d-0111-413c-99e5-bde62080dcde" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:36 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-15c94e01-6cb0-4780-ac58-0d96d9d97ceb tempest-CreateVolumesFromImageTest-1156132122 None] Lock "cinder-quobyte-ace4815d-0111-413c-99e5-bde62080dcde" acquired by "delete_volume" :: waited 0.011s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:36 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81a4c5b-e546-4ad9-a4a9-07d83213db6e]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-15c94e01-6cb0-4780-ac58-0d96d9d97ceb tempest-CreateVolumesFromImageTest-1156132122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ace4815d-0111-413c-99e5-bde62080dcde {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:36 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ace4815d-0111-413c-99e5-bde62080dcde Apr 10 10:40:36 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:36 devstack sudo[88712]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f176a5df-594d-44ba-8788-cfb50d5e6923 tempest-CreateVolumesFromImageTest-1156132122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.476s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:36 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-f176a5df-594d-44ba-8788-cfb50d5e6923 tempest-CreateVolumesFromImageTest-1156132122 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:40:36 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-f176a5df-594d-44ba-8788-cfb50d5e6923 tempest-CreateVolumesFromImageTest-1156132122 None] Deleted volume successfully. Apr 10 10:40:36 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f176a5df-594d-44ba-8788-cfb50d5e6923 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "cinder-356d7f51-3e2f-4617-a864-c6348573a4ad-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:37 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-15c94e01-6cb0-4780-ac58-0d96d9d97ceb tempest-CreateVolumesFromImageTest-1156132122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ace4815d-0111-413c-99e5-bde62080dcde" returned: 0 in 0.513s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-15c94e01-6cb0-4780-ac58-0d96d9d97ceb tempest-CreateVolumesFromImageTest-1156132122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ace4815d-0111-413c-99e5-bde62080dcde {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:37 devstack sudo[88720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ace4815d-0111-413c-99e5-bde62080dcde Apr 10 10:40:37 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:37 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-15c94e01-6cb0-4780-ac58-0d96d9d97ceb tempest-CreateVolumesFromImageTest-1156132122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ace4815d-0111-413c-99e5-bde62080dcde" returned: 0 in 0.427s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:37 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-15c94e01-6cb0-4780-ac58-0d96d9d97ceb tempest-CreateVolumesFromImageTest-1156132122 None] Lock "cinder-quobyte-ace4815d-0111-413c-99e5-bde62080dcde" released by "delete_volume" :: held 0.963s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:37 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-15c94e01-6cb0-4780-ac58-0d96d9d97ceb tempest-CreateVolumesFromImageTest-1156132122 None] Created reservations ['ea5141d6-3ac2-4992-a81f-d21dfe6f14ed', '03ea52e4-925c-40ad-8df8-1827978caf90', '05a67515-59cc-4484-b751-5dfd54b9c31e', '4fc61a93-767c-4849-b2f2-20c2ba761b5a'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-15c94e01-6cb0-4780-ac58-0d96d9d97ceb tempest-CreateVolumesFromImageTest-1156132122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-15c94e01-6cb0-4780-ac58-0d96d9d97ceb tempest-CreateVolumesFromImageTest-1156132122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:37 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-15c94e01-6cb0-4780-ac58-0d96d9d97ceb tempest-CreateVolumesFromImageTest-1156132122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:37 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-15c94e01-6cb0-4780-ac58-0d96d9d97ceb tempest-CreateVolumesFromImageTest-1156132122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-15c94e01-6cb0-4780-ac58-0d96d9d97ceb tempest-CreateVolumesFromImageTest-1156132122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-15c94e01-6cb0-4780-ac58-0d96d9d97ceb tempest-CreateVolumesFromImageTest-1156132122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:37 devstack sudo[88723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:40:37 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:38 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-15c94e01-6cb0-4780-ac58-0d96d9d97ceb tempest-CreateVolumesFromImageTest-1156132122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.425s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:38 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-15c94e01-6cb0-4780-ac58-0d96d9d97ceb tempest-CreateVolumesFromImageTest-1156132122 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:40:38 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-15c94e01-6cb0-4780-ac58-0d96d9d97ceb tempest-CreateVolumesFromImageTest-1156132122 None] Deleted volume successfully. Apr 10 10:40:38 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-15c94e01-6cb0-4780-ac58-0d96d9d97ceb tempest-CreateVolumesFromImageTest-1156132122 None] Lock "cinder-ace4815d-0111-413c-99e5-bde62080dcde-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:38 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cb68de80-5164-480a-94c8-7264f36fcca6 tempest-CreateVolumesFromImageTest-1156132122 None] Acquiring lock "cinder-73907698-8c13-4ff7-a0ed-4d08327b0435-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:38 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cb68de80-5164-480a-94c8-7264f36fcca6 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "cinder-73907698-8c13-4ff7-a0ed-4d08327b0435-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:38 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cb68de80-5164-480a-94c8-7264f36fcca6 tempest-CreateVolumesFromImageTest-1156132122 None] Acquiring lock "cinder-quobyte-73907698-8c13-4ff7-a0ed-4d08327b0435" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:38 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cb68de80-5164-480a-94c8-7264f36fcca6 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "cinder-quobyte-73907698-8c13-4ff7-a0ed-4d08327b0435" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:38 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16925ce-bc47-4e38-9149-9e1a6248aad6]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cb68de80-5164-480a-94c8-7264f36fcca6 tempest-CreateVolumesFromImageTest-1156132122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-73907698-8c13-4ff7-a0ed-4d08327b0435 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:38 devstack sudo[88726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-73907698-8c13-4ff7-a0ed-4d08327b0435 Apr 10 10:40:38 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:39 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cb68de80-5164-480a-94c8-7264f36fcca6 tempest-CreateVolumesFromImageTest-1156132122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-73907698-8c13-4ff7-a0ed-4d08327b0435" returned: 0 in 0.528s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cb68de80-5164-480a-94c8-7264f36fcca6 tempest-CreateVolumesFromImageTest-1156132122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-73907698-8c13-4ff7-a0ed-4d08327b0435 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:39 devstack sudo[88731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-73907698-8c13-4ff7-a0ed-4d08327b0435 Apr 10 10:40:39 devstack sudo[88731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:39 devstack sudo[88731]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cb68de80-5164-480a-94c8-7264f36fcca6 tempest-CreateVolumesFromImageTest-1156132122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-73907698-8c13-4ff7-a0ed-4d08327b0435" returned: 0 in 0.467s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:39 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cb68de80-5164-480a-94c8-7264f36fcca6 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "cinder-quobyte-73907698-8c13-4ff7-a0ed-4d08327b0435" released by "delete_volume" :: held 1.024s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:39 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-cb68de80-5164-480a-94c8-7264f36fcca6 tempest-CreateVolumesFromImageTest-1156132122 None] Created reservations ['66457f69-87f6-4c33-b496-1b4f1c1c77bb', '7ae09685-cf86-4729-9f36-5b9ace09d9c2', '56c537a8-022b-494f-a149-56355c3756ad', '4e72c09d-9f1b-452c-853b-d0ffafa9c04b'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-cb68de80-5164-480a-94c8-7264f36fcca6 tempest-CreateVolumesFromImageTest-1156132122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-cb68de80-5164-480a-94c8-7264f36fcca6 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:39 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-cb68de80-5164-480a-94c8-7264f36fcca6 tempest-CreateVolumesFromImageTest-1156132122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:39 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-cb68de80-5164-480a-94c8-7264f36fcca6 tempest-CreateVolumesFromImageTest-1156132122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-cb68de80-5164-480a-94c8-7264f36fcca6 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cb68de80-5164-480a-94c8-7264f36fcca6 tempest-CreateVolumesFromImageTest-1156132122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:39 devstack sudo[88734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:40:39 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:40 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-cb68de80-5164-480a-94c8-7264f36fcca6 tempest-CreateVolumesFromImageTest-1156132122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.479s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:40 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-cb68de80-5164-480a-94c8-7264f36fcca6 tempest-CreateVolumesFromImageTest-1156132122 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:40:40 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-cb68de80-5164-480a-94c8-7264f36fcca6 tempest-CreateVolumesFromImageTest-1156132122 None] Deleted volume successfully. Apr 10 10:40:40 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-cb68de80-5164-480a-94c8-7264f36fcca6 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "cinder-73907698-8c13-4ff7-a0ed-4d08327b0435-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:40 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-3faec37f-9c9c-4d0c-b8a4-f6ee1ffb3607 tempest-CreateVolumesFromImageTest-1156132122 None] Acquiring lock "cinder-61218107-6fe9-4260-86d6-c26f1f620e3e-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:40 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-3faec37f-9c9c-4d0c-b8a4-f6ee1ffb3607 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "cinder-61218107-6fe9-4260-86d6-c26f1f620e3e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:40 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-3faec37f-9c9c-4d0c-b8a4-f6ee1ffb3607 tempest-CreateVolumesFromImageTest-1156132122 None] Acquiring lock "cinder-quobyte-61218107-6fe9-4260-86d6-c26f1f620e3e" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:40 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-3faec37f-9c9c-4d0c-b8a4-f6ee1ffb3607 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "cinder-quobyte-61218107-6fe9-4260-86d6-c26f1f620e3e" acquired by "delete_volume" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:40 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d04e7f-5f1b-4efc-8040-59e18e7ea37d]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3faec37f-9c9c-4d0c-b8a4-f6ee1ffb3607 tempest-CreateVolumesFromImageTest-1156132122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-61218107-6fe9-4260-86d6-c26f1f620e3e {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:41 devstack sudo[88738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-61218107-6fe9-4260-86d6-c26f1f620e3e Apr 10 10:40:41 devstack sudo[88738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:41 devstack sudo[88738]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3faec37f-9c9c-4d0c-b8a4-f6ee1ffb3607 tempest-CreateVolumesFromImageTest-1156132122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-61218107-6fe9-4260-86d6-c26f1f620e3e" returned: 0 in 0.490s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3faec37f-9c9c-4d0c-b8a4-f6ee1ffb3607 tempest-CreateVolumesFromImageTest-1156132122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-61218107-6fe9-4260-86d6-c26f1f620e3e {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:41 devstack sudo[88743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-61218107-6fe9-4260-86d6-c26f1f620e3e Apr 10 10:40:41 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:41 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3faec37f-9c9c-4d0c-b8a4-f6ee1ffb3607 tempest-CreateVolumesFromImageTest-1156132122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-61218107-6fe9-4260-86d6-c26f1f620e3e" returned: 0 in 0.433s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:41 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-3faec37f-9c9c-4d0c-b8a4-f6ee1ffb3607 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "cinder-quobyte-61218107-6fe9-4260-86d6-c26f1f620e3e" released by "delete_volume" :: held 0.949s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:41 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-3faec37f-9c9c-4d0c-b8a4-f6ee1ffb3607 tempest-CreateVolumesFromImageTest-1156132122 None] Created reservations ['3ade760b-2f3c-44ee-b624-ee8666d32a7c', 'f1b26eec-1c2b-4c3e-ad31-ebaa341be0fc', 'd7a33efc-7f58-4339-a015-a812938b1d5b', 'cf7f2536-f5e8-483c-8723-05da38f4122c'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3faec37f-9c9c-4d0c-b8a4-f6ee1ffb3607 tempest-CreateVolumesFromImageTest-1156132122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3faec37f-9c9c-4d0c-b8a4-f6ee1ffb3607 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:42 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3faec37f-9c9c-4d0c-b8a4-f6ee1ffb3607 tempest-CreateVolumesFromImageTest-1156132122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:42 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3faec37f-9c9c-4d0c-b8a4-f6ee1ffb3607 tempest-CreateVolumesFromImageTest-1156132122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3faec37f-9c9c-4d0c-b8a4-f6ee1ffb3607 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3faec37f-9c9c-4d0c-b8a4-f6ee1ffb3607 tempest-CreateVolumesFromImageTest-1156132122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:42 devstack sudo[88746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:40:42 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:42 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3faec37f-9c9c-4d0c-b8a4-f6ee1ffb3607 tempest-CreateVolumesFromImageTest-1156132122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.519s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:42 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-3faec37f-9c9c-4d0c-b8a4-f6ee1ffb3607 tempest-CreateVolumesFromImageTest-1156132122 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:40:42 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-3faec37f-9c9c-4d0c-b8a4-f6ee1ffb3607 tempest-CreateVolumesFromImageTest-1156132122 None] Deleted volume successfully. Apr 10 10:40:42 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-3faec37f-9c9c-4d0c-b8a4-f6ee1ffb3607 tempest-CreateVolumesFromImageTest-1156132122 None] Lock "cinder-61218107-6fe9-4260-86d6-c26f1f620e3e-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:43 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] Flow 'volume_create_manager' (198f5e52-a1f6-4a2d-801d-b80abe43a68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7818091d-fa95-4970-95f4-d523d4bebae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7818091d-fa95-4970-95f4-d523d4bebae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53e2dbd0-dd5a-4796-b15f-05e06fcd18f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebee4b978fc042e0a1470030e3812577',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:44Z,use_quota=True,user_id='bbe6f0fdb5aa4b93950bec90a0dee61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5bffc5-d480-4dde-a844-c755b6205a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5bffc5-d480-4dde-a844-c755b6205a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6217ca-20e8-4398-a373-1954a1bb30f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6217ca-20e8-4398-a373-1954a1bb30f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53e2dbd0-dd5a-4796-b15f-05e06fcd18f1', 'volume_name': 'volume-53e2dbd0-dd5a-4796-b15f-05e06fcd18f1', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (545dfda7-7d8a-4bec-b8f8-83223386d72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (545dfda7-7d8a-4bec-b8f8-83223386d72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (164e24e1-7f2f-4c80-a01e-17e7ed2f984c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:43 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] Volume 53e2dbd0-dd5a-4796-b15f-05e06fcd18f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53e2dbd0-dd5a-4796-b15f-05e06fcd18f1', 'volume_size': 1} Apr 10 10:40:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:43 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53e2dbd0-dd5a-4796-b15f-05e06fcd18f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebee4b978fc042e0a1470030e3812577',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:44Z,use_quota=True,user_id='bbe6f0fdb5aa4b93950bec90a0dee61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:40:43 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] Creating volume 53e2dbd0-dd5a-4796-b15f-05e06fcd18f1 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:40:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:43 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:43 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:43 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:40:43 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:40:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-53e2dbd0-dd5a-4796-b15f-05e06fcd18f1 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:43 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-53e2dbd0-dd5a-4796-b15f-05e06fcd18f1 1073741824 Apr 10 10:40:43 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:44 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-53e2dbd0-dd5a-4796-b15f-05e06fcd18f1 1073741824" returned: 0 in 0.507s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-53e2dbd0-dd5a-4796-b15f-05e06fcd18f1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:44 devstack sudo[88754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-53e2dbd0-dd5a-4796-b15f-05e06fcd18f1 Apr 10 10:40:44 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:44 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-53e2dbd0-dd5a-4796-b15f-05e06fcd18f1" returned: 0 in 0.450s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:44 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:40:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:44 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (164e24e1-7f2f-4c80-a01e-17e7ed2f984c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53e2dbd0-dd5a-4796-b15f-05e06fcd18f1', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:44 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7277b79b-3c52-470a-9b41-1192c0e7645a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:44 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] Volume volume-53e2dbd0-dd5a-4796-b15f-05e06fcd18f1 (53e2dbd0-dd5a-4796-b15f-05e06fcd18f1): created successfully Apr 10 10:40:44 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7277b79b-3c52-470a-9b41-1192c0e7645a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:44 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] Flow 'volume_create_manager' (198f5e52-a1f6-4a2d-801d-b80abe43a68e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:44 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-9d3c887c-19e5-42e8-b69b-ef9e95c88103 tempest-CinderUnicodeTest-549070110 None] Created volume successfully. Apr 10 10:40:46 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writing DB stats cinder:SELECT=96,cinder:INSERT=32,cinder:UPDATE=126,cinder:DELETE=11 {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:40:46 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] Flow 'volume_create_manager' (46146d5c-7178-425d-9e90-8655f878c13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc8cf83-687e-4bd3-8e7f-db58abdf4ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc8cf83-687e-4bd3-8e7f-db58abdf4ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1466667777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=decce853-5695-451a-8448-0189b1049ea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebee4b978fc042e0a1470030e3812577',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:46Z,use_quota=True,user_id='bbe6f0fdb5aa4b93950bec90a0dee61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43403fc7-2f2f-43ed-a462-f0a3a3f8d247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43403fc7-2f2f-43ed-a462-f0a3a3f8d247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6424f3c9-09c6-479c-91e1-82e3c66618e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6424f3c9-09c6-479c-91e1-82e3c66618e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'decce853-5695-451a-8448-0189b1049ea2', 'volume_name': 'volume-decce853-5695-451a-8448-0189b1049ea2', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a43600e2-5be0-4f13-a6b3-eb54acd9dbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a43600e2-5be0-4f13-a6b3-eb54acd9dbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd9b59ac-72eb-412c-80f7-536ee4892091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:46 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] Volume decce853-5695-451a-8448-0189b1049ea2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-decce853-5695-451a-8448-0189b1049ea2', 'volume_size': 1} Apr 10 10:40:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:46 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1466667777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=decce853-5695-451a-8448-0189b1049ea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebee4b978fc042e0a1470030e3812577',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:46Z,use_quota=True,user_id='bbe6f0fdb5aa4b93950bec90a0dee61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:40:46 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] Creating volume decce853-5695-451a-8448-0189b1049ea2 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:40:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:46 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:46 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:46 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:40:46 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:40:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:46 devstack sudo[88757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2 1073741824 Apr 10 10:40:46 devstack sudo[88757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:46 devstack sudo[88757]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2 1073741824" returned: 0 in 0.475s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:46 devstack sudo[88762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2 Apr 10 10:40:46 devstack sudo[88762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:47 devstack sudo[88762]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2" returned: 0 in 0.399s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:47 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:40:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd9b59ac-72eb-412c-80f7-536ee4892091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-decce853-5695-451a-8448-0189b1049ea2', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43112e19-3269-44cd-83f7-b37eb91f6d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:47 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] Volume volume-decce853-5695-451a-8448-0189b1049ea2 (decce853-5695-451a-8448-0189b1049ea2): created successfully Apr 10 10:40:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43112e19-3269-44cd-83f7-b37eb91f6d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] Flow 'volume_create_manager' (46146d5c-7178-425d-9e90-8655f878c13a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:47 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-e7568c56-7ef0-42e0-b182-30edf9ffea70 tempest-CinderUnicodeTest-549070110 None] Created volume successfully. Apr 10 10:40:48 devstack cinder-volume[81938]: DEBUG oslo_service.periodic_task [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81938) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:40:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:48 devstack sudo[88765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:40:48 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:48 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.443s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:48 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:40:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-9acc727c-5239-4f3e-b640-908b3003262b tempest-CinderUnicodeTest-549070110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-9acc727c-5239-4f3e-b640-908b3003262b tempest-CinderUnicodeTest-549070110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-9acc727c-5239-4f3e-b640-908b3003262b tempest-CinderUnicodeTest-549070110 None] Creating offline snapshot 284dceb7-016d-42aa-849c-de21bc31aa8e of volume decce853-5695-451a-8448-0189b1049ea2 {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:40:48 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef26954-bc34-491a-a5dd-8c4ba3dd4370]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9acc727c-5239-4f3e-b640-908b3003262b tempest-CinderUnicodeTest-549070110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:48 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2 Apr 10 10:40:48 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:49 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9acc727c-5239-4f3e-b640-908b3003262b tempest-CinderUnicodeTest-549070110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2" returned: 0 in 0.492s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9acc727c-5239-4f3e-b640-908b3003262b tempest-CinderUnicodeTest-549070110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2.284dceb7-016d-42aa-849c-de21bc31aa8e 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:49 devstack sudo[88779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2.284dceb7-016d-42aa-849c-de21bc31aa8e 1G Apr 10 10:40:49 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:49 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9acc727c-5239-4f3e-b640-908b3003262b tempest-CinderUnicodeTest-549070110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2.284dceb7-016d-42aa-849c-de21bc31aa8e 1G" returned: 0 in 0.528s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9acc727c-5239-4f3e-b640-908b3003262b tempest-CinderUnicodeTest-549070110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-decce853-5695-451a-8448-0189b1049ea2 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2.284dceb7-016d-42aa-849c-de21bc31aa8e {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:49 devstack sudo[88784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-decce853-5695-451a-8448-0189b1049ea2 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2.284dceb7-016d-42aa-849c-de21bc31aa8e Apr 10 10:40:49 devstack sudo[88784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:50 devstack sudo[88784]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9acc727c-5239-4f3e-b640-908b3003262b tempest-CinderUnicodeTest-549070110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-decce853-5695-451a-8448-0189b1049ea2 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2.284dceb7-016d-42aa-849c-de21bc31aa8e" returned: 0 in 0.438s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:50 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-9acc727c-5239-4f3e-b640-908b3003262b tempest-CinderUnicodeTest-549070110 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2.284dceb7-016d-42aa-849c-de21bc31aa8e is being set with open permissions: ugo+rw Apr 10 10:40:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9acc727c-5239-4f3e-b640-908b3003262b tempest-CinderUnicodeTest-549070110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2.284dceb7-016d-42aa-849c-de21bc31aa8e {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:50 devstack sudo[88790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2.284dceb7-016d-42aa-849c-de21bc31aa8e Apr 10 10:40:50 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:50 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9acc727c-5239-4f3e-b640-908b3003262b tempest-CinderUnicodeTest-549070110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2.284dceb7-016d-42aa-849c-de21bc31aa8e" returned: 0 in 0.408s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9acc727c-5239-4f3e-b640-908b3003262b tempest-CinderUnicodeTest-549070110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:50 devstack sudo[88793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2.info Apr 10 10:40:50 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:50 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9acc727c-5239-4f3e-b640-908b3003262b tempest-CinderUnicodeTest-549070110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2.info" returned: 0 in 0.420s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:50 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-9acc727c-5239-4f3e-b640-908b3003262b tempest-CinderUnicodeTest-549070110 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2.info is being set with open permissions: ugo+rw Apr 10 10:40:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9acc727c-5239-4f3e-b640-908b3003262b tempest-CinderUnicodeTest-549070110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:50 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2.info Apr 10 10:40:50 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:51 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-9acc727c-5239-4f3e-b640-908b3003262b tempest-CinderUnicodeTest-549070110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2.info" returned: 0 in 0.453s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-9acc727c-5239-4f3e-b640-908b3003262b tempest-CinderUnicodeTest-549070110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.797s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:51 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-9acc727c-5239-4f3e-b640-908b3003262b tempest-CinderUnicodeTest-549070110 None] Create snapshot completed successfully Apr 10 10:40:51 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7b41a57e-ad0f-4832-a6e4-9c5ff276cd27 tempest-CinderUnicodeTest-549070110 None] Acquiring lock "cinder-284dceb7-016d-42aa-849c-de21bc31aa8e-delete_snapshot" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:51 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7b41a57e-ad0f-4832-a6e4-9c5ff276cd27 tempest-CinderUnicodeTest-549070110 None] Lock "cinder-284dceb7-016d-42aa-849c-de21bc31aa8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:51 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7b41a57e-ad0f-4832-a6e4-9c5ff276cd27 tempest-CinderUnicodeTest-549070110 None] Acquiring lock "cinder-quobyte-decce853-5695-451a-8448-0189b1049ea2" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:51 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7b41a57e-ad0f-4832-a6e4-9c5ff276cd27 tempest-CinderUnicodeTest-549070110 None] Lock "cinder-quobyte-decce853-5695-451a-8448-0189b1049ea2" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:51 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7b41a57e-ad0f-4832-a6e4-9c5ff276cd27 tempest-CinderUnicodeTest-549070110 None] Acquiring lock "cinder-quobyte-284dceb7-016d-42aa-849c-de21bc31aa8e" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:51 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7b41a57e-ad0f-4832-a6e4-9c5ff276cd27 tempest-CinderUnicodeTest-549070110 None] Lock "cinder-quobyte-284dceb7-016d-42aa-849c-de21bc31aa8e" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:51 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-7b41a57e-ad0f-4832-a6e4-9c5ff276cd27 tempest-CinderUnicodeTest-549070110 None] Deleting offline snapshot 284dceb7-016d-42aa-849c-de21bc31aa8e of volume decce853-5695-451a-8448-0189b1049ea2 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:40:51 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-7b41a57e-ad0f-4832-a6e4-9c5ff276cd27 tempest-CinderUnicodeTest-549070110 None] snapshot_file for this snap is: volume-decce853-5695-451a-8448-0189b1049ea2.284dceb7-016d-42aa-849c-de21bc31aa8e {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:40:51 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[033a8f24-efc6-4ee8-a800-18bd0649834d]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7b41a57e-ad0f-4832-a6e4-9c5ff276cd27 tempest-CinderUnicodeTest-549070110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2.284dceb7-016d-42aa-849c-de21bc31aa8e {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:51 devstack sudo[88799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2.284dceb7-016d-42aa-849c-de21bc31aa8e Apr 10 10:40:51 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:52 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7b41a57e-ad0f-4832-a6e4-9c5ff276cd27 tempest-CinderUnicodeTest-549070110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2.284dceb7-016d-42aa-849c-de21bc31aa8e" returned: 0 in 0.510s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:52 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-7b41a57e-ad0f-4832-a6e4-9c5ff276cd27 tempest-CinderUnicodeTest-549070110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-decce853-5695-451a-8448-0189b1049ea2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:40:52 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[7589147a-a897-4f92-8de1-63d9ec6582d6]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7b41a57e-ad0f-4832-a6e4-9c5ff276cd27 tempest-CinderUnicodeTest-549070110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:52 devstack sudo[88804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2 Apr 10 10:40:52 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:52 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7b41a57e-ad0f-4832-a6e4-9c5ff276cd27 tempest-CinderUnicodeTest-549070110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2" returned: 0 in 0.489s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7b41a57e-ad0f-4832-a6e4-9c5ff276cd27 tempest-CinderUnicodeTest-549070110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2.284dceb7-016d-42aa-849c-de21bc31aa8e {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:52 devstack sudo[88809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2.284dceb7-016d-42aa-849c-de21bc31aa8e Apr 10 10:40:52 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:53 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7b41a57e-ad0f-4832-a6e4-9c5ff276cd27 tempest-CinderUnicodeTest-549070110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2.284dceb7-016d-42aa-849c-de21bc31aa8e" returned: 0 in 0.532s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7b41a57e-ad0f-4832-a6e4-9c5ff276cd27 tempest-CinderUnicodeTest-549070110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2.284dceb7-016d-42aa-849c-de21bc31aa8e {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:53 devstack sudo[88814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2.284dceb7-016d-42aa-849c-de21bc31aa8e Apr 10 10:40:53 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:53 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7b41a57e-ad0f-4832-a6e4-9c5ff276cd27 tempest-CinderUnicodeTest-549070110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2.284dceb7-016d-42aa-849c-de21bc31aa8e" returned: 0 in 0.412s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:53 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7b41a57e-ad0f-4832-a6e4-9c5ff276cd27 tempest-CinderUnicodeTest-549070110 None] Lock "cinder-quobyte-284dceb7-016d-42aa-849c-de21bc31aa8e" released by "_delete_snapshot" :: held 2.016s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:53 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7b41a57e-ad0f-4832-a6e4-9c5ff276cd27 tempest-CinderUnicodeTest-549070110 None] Lock "cinder-quobyte-decce853-5695-451a-8448-0189b1049ea2" released by "delete_snapshot" :: held 2.032s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:53 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-7b41a57e-ad0f-4832-a6e4-9c5ff276cd27 tempest-CinderUnicodeTest-549070110 None] Created reservations ['937c746a-35d4-45fd-a55b-2646cfafc12a', '5f49d104-e547-41fe-aa92-5bba409f3e99', 'b0be1e73-d970-48d6-bf63-56b9b1ca3ee3', '7d07b6cf-60fc-411f-85b5-25b85f2c8ce5'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:53 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-7b41a57e-ad0f-4832-a6e4-9c5ff276cd27 tempest-CinderUnicodeTest-549070110 None] Delete snapshot completed successfully. Apr 10 10:40:53 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7b41a57e-ad0f-4832-a6e4-9c5ff276cd27 tempest-CinderUnicodeTest-549070110 None] Lock "cinder-284dceb7-016d-42aa-849c-de21bc31aa8e-delete_snapshot" released by "delete_snapshot" :: held 2.129s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:54 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-11114892-9390-4b71-97a5-c53e5a5547c5 tempest-CinderUnicodeTest-549070110 None] Acquiring lock "cinder-decce853-5695-451a-8448-0189b1049ea2-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:54 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-11114892-9390-4b71-97a5-c53e5a5547c5 tempest-CinderUnicodeTest-549070110 None] Lock "cinder-decce853-5695-451a-8448-0189b1049ea2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:54 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-11114892-9390-4b71-97a5-c53e5a5547c5 tempest-CinderUnicodeTest-549070110 None] Acquiring lock "cinder-quobyte-decce853-5695-451a-8448-0189b1049ea2" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:54 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-11114892-9390-4b71-97a5-c53e5a5547c5 tempest-CinderUnicodeTest-549070110 None] Lock "cinder-quobyte-decce853-5695-451a-8448-0189b1049ea2" acquired by "delete_volume" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:55 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[6750014d-3ba0-4f2a-845a-9ca3e65724c0]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-11114892-9390-4b71-97a5-c53e5a5547c5 tempest-CinderUnicodeTest-549070110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:55 devstack sudo[88817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2 Apr 10 10:40:55 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:55 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-11114892-9390-4b71-97a5-c53e5a5547c5 tempest-CinderUnicodeTest-549070110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2" returned: 0 in 0.526s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-11114892-9390-4b71-97a5-c53e5a5547c5 tempest-CinderUnicodeTest-549070110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:55 devstack sudo[88822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2 Apr 10 10:40:55 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:55 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-11114892-9390-4b71-97a5-c53e5a5547c5 tempest-CinderUnicodeTest-549070110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-decce853-5695-451a-8448-0189b1049ea2" returned: 0 in 0.406s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:55 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-11114892-9390-4b71-97a5-c53e5a5547c5 tempest-CinderUnicodeTest-549070110 None] Lock "cinder-quobyte-decce853-5695-451a-8448-0189b1049ea2" released by "delete_volume" :: held 0.968s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:55 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-11114892-9390-4b71-97a5-c53e5a5547c5 tempest-CinderUnicodeTest-549070110 None] Created reservations ['ee574fee-33a0-4ecf-911e-b0e3c8d0d09b', 'cb56068c-86bf-404a-b214-6659179b6c8e', '975442dd-7c0c-4389-ae2c-b4f768648037', '8a5e6b0a-3939-4e89-aa10-589ebbd8b947'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-11114892-9390-4b71-97a5-c53e5a5547c5 tempest-CinderUnicodeTest-549070110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-11114892-9390-4b71-97a5-c53e5a5547c5 tempest-CinderUnicodeTest-549070110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:56 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-11114892-9390-4b71-97a5-c53e5a5547c5 tempest-CinderUnicodeTest-549070110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:56 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-11114892-9390-4b71-97a5-c53e5a5547c5 tempest-CinderUnicodeTest-549070110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-11114892-9390-4b71-97a5-c53e5a5547c5 tempest-CinderUnicodeTest-549070110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-11114892-9390-4b71-97a5-c53e5a5547c5 tempest-CinderUnicodeTest-549070110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:56 devstack sudo[88826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:40:56 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:56 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c9e61b6a-06e1-4f9b-9af0-a8b74c9dade3 tempest-CinderUnicodeTest-549070110 None] Acquiring lock "cinder-53e2dbd0-dd5a-4796-b15f-05e06fcd18f1-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:56 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c9e61b6a-06e1-4f9b-9af0-a8b74c9dade3 tempest-CinderUnicodeTest-549070110 None] Lock "cinder-53e2dbd0-dd5a-4796-b15f-05e06fcd18f1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:56 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c9e61b6a-06e1-4f9b-9af0-a8b74c9dade3 tempest-CinderUnicodeTest-549070110 None] Acquiring lock "cinder-quobyte-53e2dbd0-dd5a-4796-b15f-05e06fcd18f1" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:56 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c9e61b6a-06e1-4f9b-9af0-a8b74c9dade3 tempest-CinderUnicodeTest-549070110 None] Lock "cinder-quobyte-53e2dbd0-dd5a-4796-b15f-05e06fcd18f1" acquired by "delete_volume" :: waited 0.017s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:56 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[7358db7c-81c4-4fbb-9b18-79a80f05039c]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c9e61b6a-06e1-4f9b-9af0-a8b74c9dade3 tempest-CinderUnicodeTest-549070110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-53e2dbd0-dd5a-4796-b15f-05e06fcd18f1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:56 devstack sudo[88828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-53e2dbd0-dd5a-4796-b15f-05e06fcd18f1 Apr 10 10:40:56 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:56 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-11114892-9390-4b71-97a5-c53e5a5547c5 tempest-CinderUnicodeTest-549070110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.457s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:56 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-11114892-9390-4b71-97a5-c53e5a5547c5 tempest-CinderUnicodeTest-549070110 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:40:56 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-11114892-9390-4b71-97a5-c53e5a5547c5 tempest-CinderUnicodeTest-549070110 None] Deleted volume successfully. Apr 10 10:40:56 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-11114892-9390-4b71-97a5-c53e5a5547c5 tempest-CinderUnicodeTest-549070110 None] Lock "cinder-decce853-5695-451a-8448-0189b1049ea2-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:56 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c9e61b6a-06e1-4f9b-9af0-a8b74c9dade3 tempest-CinderUnicodeTest-549070110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-53e2dbd0-dd5a-4796-b15f-05e06fcd18f1" returned: 0 in 0.491s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c9e61b6a-06e1-4f9b-9af0-a8b74c9dade3 tempest-CinderUnicodeTest-549070110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-53e2dbd0-dd5a-4796-b15f-05e06fcd18f1 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:56 devstack sudo[88834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-53e2dbd0-dd5a-4796-b15f-05e06fcd18f1 Apr 10 10:40:56 devstack sudo[88834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:57 devstack sudo[88834]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c9e61b6a-06e1-4f9b-9af0-a8b74c9dade3 tempest-CinderUnicodeTest-549070110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-53e2dbd0-dd5a-4796-b15f-05e06fcd18f1" returned: 0 in 0.446s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:57 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c9e61b6a-06e1-4f9b-9af0-a8b74c9dade3 tempest-CinderUnicodeTest-549070110 None] Lock "cinder-quobyte-53e2dbd0-dd5a-4796-b15f-05e06fcd18f1" released by "delete_volume" :: held 0.968s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:57 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-c9e61b6a-06e1-4f9b-9af0-a8b74c9dade3 tempest-CinderUnicodeTest-549070110 None] Created reservations ['76227a5c-bf2d-42ce-82f7-f626830d797d', 'c8fe8020-9bd4-464f-a36b-2ff4f156c105', 'd2b62f6c-6e39-4aaa-9a31-1c1bd533febd', 'e5e3543f-88d5-43a4-98dd-dc7a7c93a532'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c9e61b6a-06e1-4f9b-9af0-a8b74c9dade3 tempest-CinderUnicodeTest-549070110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c9e61b6a-06e1-4f9b-9af0-a8b74c9dade3 tempest-CinderUnicodeTest-549070110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:57 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c9e61b6a-06e1-4f9b-9af0-a8b74c9dade3 tempest-CinderUnicodeTest-549070110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:57 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c9e61b6a-06e1-4f9b-9af0-a8b74c9dade3 tempest-CinderUnicodeTest-549070110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c9e61b6a-06e1-4f9b-9af0-a8b74c9dade3 tempest-CinderUnicodeTest-549070110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c9e61b6a-06e1-4f9b-9af0-a8b74c9dade3 tempest-CinderUnicodeTest-549070110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:57 devstack sudo[88837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:40:57 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:57 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c9e61b6a-06e1-4f9b-9af0-a8b74c9dade3 tempest-CinderUnicodeTest-549070110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.499s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:57 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-c9e61b6a-06e1-4f9b-9af0-a8b74c9dade3 tempest-CinderUnicodeTest-549070110 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:40:57 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-c9e61b6a-06e1-4f9b-9af0-a8b74c9dade3 tempest-CinderUnicodeTest-549070110 None] Deleted volume successfully. Apr 10 10:40:57 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-c9e61b6a-06e1-4f9b-9af0-a8b74c9dade3 tempest-CinderUnicodeTest-549070110 None] Lock "cinder-53e2dbd0-dd5a-4796-b15f-05e06fcd18f1-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:07 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writing DB stats cinder:SELECT=24,cinder:UPDATE=26,cinder:INSERT=6,cinder:DELETE=1 {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:41:07 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writing DB stats cinder:SELECT=69,cinder:INSERT=27,cinder:UPDATE=90,cinder:DELETE=9 {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:41:14 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:14 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] Flow 'volume_create_manager' (86715173-e60a-4fff-b61e-4385b81caf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:14 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06f4f708-6748-4849-bb4e-e593eeeb95f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:14 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06f4f708-6748-4849-bb4e-e593eeeb95f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-476744737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f351c0d6-2a4f-4be3-9309-b5eba942fce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1ebd57ddacc474687406801aaffadf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:15Z,use_quota=True,user_id='d5f1b9c3a3fd4d2dbfa176876b7ec79c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:14 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c61ad1a8-45ba-4f1b-bdfe-f7ca0e4ec64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:14 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c61ad1a8-45ba-4f1b-bdfe-f7ca0e4ec64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:14 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (376e2b8d-1b97-4364-9ef2-9127678e700e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:14 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (376e2b8d-1b97-4364-9ef2-9127678e700e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f351c0d6-2a4f-4be3-9309-b5eba942fce7', 'volume_name': 'volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:14 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f088ef7-fede-4ee9-82e3-af9309a4b3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:14 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f088ef7-fede-4ee9-82e3-af9309a4b3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:14 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df832b6-ba5b-434e-a7a3-cb97b3003f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:14 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] Volume f351c0d6-2a4f-4be3-9309-b5eba942fce7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7', 'volume_size': 1} Apr 10 10:41:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:14 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-476744737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f351c0d6-2a4f-4be3-9309-b5eba942fce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1ebd57ddacc474687406801aaffadf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:15Z,use_quota=True,user_id='d5f1b9c3a3fd4d2dbfa176876b7ec79c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:41:14 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] Creating volume f351c0d6-2a4f-4be3-9309-b5eba942fce7 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:41:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:14 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:14 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:14 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:14 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:41:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:14 devstack sudo[88878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7 1073741824 Apr 10 10:41:14 devstack sudo[88878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:15 devstack sudo[88878]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7 1073741824" returned: 0 in 0.488s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:15 devstack sudo[88883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7 Apr 10 10:41:15 devstack sudo[88883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:15 devstack sudo[88883]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7" returned: 0 in 0.423s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:15 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:41:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:15 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df832b6-ba5b-434e-a7a3-cb97b3003f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:15 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce5daace-56c1-4700-8f6d-78e5fdb4b29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:15 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] Volume volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7 (f351c0d6-2a4f-4be3-9309-b5eba942fce7): created successfully Apr 10 10:41:15 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce5daace-56c1-4700-8f6d-78e5fdb4b29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:15 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] Flow 'volume_create_manager' (86715173-e60a-4fff-b61e-4385b81caf0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:15 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-c79ccf5d-510f-43d1-a9c3-0d2d56aac62f tempest-SnapshotDependencyTests-2122686831 None] Created volume successfully. Apr 10 10:41:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-95374d23-2841-44cc-87dd-c64c098933e2 tempest-SnapshotDependencyTests-2122686831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-95374d23-2841-44cc-87dd-c64c098933e2 tempest-SnapshotDependencyTests-2122686831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:16 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-95374d23-2841-44cc-87dd-c64c098933e2 tempest-SnapshotDependencyTests-2122686831 None] Creating offline snapshot 9aaefd45-1ffc-4022-a0f1-e4b9375b6f04 of volume f351c0d6-2a4f-4be3-9309-b5eba942fce7 {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:41:16 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[78804d0c-187c-45b9-aa59-12e819cb7249]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-95374d23-2841-44cc-87dd-c64c098933e2 tempest-SnapshotDependencyTests-2122686831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:16 devstack sudo[88886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7 Apr 10 10:41:16 devstack sudo[88886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:17 devstack sudo[88886]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-95374d23-2841-44cc-87dd-c64c098933e2 tempest-SnapshotDependencyTests-2122686831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7" returned: 0 in 0.483s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-95374d23-2841-44cc-87dd-c64c098933e2 tempest-SnapshotDependencyTests-2122686831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7.9aaefd45-1ffc-4022-a0f1-e4b9375b6f04 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:17 devstack sudo[88891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7.9aaefd45-1ffc-4022-a0f1-e4b9375b6f04 1G Apr 10 10:41:17 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:17 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-95374d23-2841-44cc-87dd-c64c098933e2 tempest-SnapshotDependencyTests-2122686831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7.9aaefd45-1ffc-4022-a0f1-e4b9375b6f04 1G" returned: 0 in 0.498s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-95374d23-2841-44cc-87dd-c64c098933e2 tempest-SnapshotDependencyTests-2122686831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7.9aaefd45-1ffc-4022-a0f1-e4b9375b6f04 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:17 devstack sudo[88896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7.9aaefd45-1ffc-4022-a0f1-e4b9375b6f04 Apr 10 10:41:17 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:18 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-95374d23-2841-44cc-87dd-c64c098933e2 tempest-SnapshotDependencyTests-2122686831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7.9aaefd45-1ffc-4022-a0f1-e4b9375b6f04" returned: 0 in 0.460s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:18 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-95374d23-2841-44cc-87dd-c64c098933e2 tempest-SnapshotDependencyTests-2122686831 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7.9aaefd45-1ffc-4022-a0f1-e4b9375b6f04 is being set with open permissions: ugo+rw Apr 10 10:41:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-95374d23-2841-44cc-87dd-c64c098933e2 tempest-SnapshotDependencyTests-2122686831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7.9aaefd45-1ffc-4022-a0f1-e4b9375b6f04 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:18 devstack sudo[88901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7.9aaefd45-1ffc-4022-a0f1-e4b9375b6f04 Apr 10 10:41:18 devstack sudo[88901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:18 devstack sudo[88901]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-95374d23-2841-44cc-87dd-c64c098933e2 tempest-SnapshotDependencyTests-2122686831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7.9aaefd45-1ffc-4022-a0f1-e4b9375b6f04" returned: 0 in 0.458s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-95374d23-2841-44cc-87dd-c64c098933e2 tempest-SnapshotDependencyTests-2122686831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:18 devstack sudo[88904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7.info Apr 10 10:41:18 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:19 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-95374d23-2841-44cc-87dd-c64c098933e2 tempest-SnapshotDependencyTests-2122686831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7.info" returned: 0 in 0.486s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:19 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-95374d23-2841-44cc-87dd-c64c098933e2 tempest-SnapshotDependencyTests-2122686831 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7.info is being set with open permissions: ugo+rw Apr 10 10:41:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-95374d23-2841-44cc-87dd-c64c098933e2 tempest-SnapshotDependencyTests-2122686831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:19 devstack sudo[88907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7.info Apr 10 10:41:19 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:19 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-95374d23-2841-44cc-87dd-c64c098933e2 tempest-SnapshotDependencyTests-2122686831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7.info" returned: 0 in 0.442s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-95374d23-2841-44cc-87dd-c64c098933e2 tempest-SnapshotDependencyTests-2122686831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.891s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:19 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-95374d23-2841-44cc-87dd-c64c098933e2 tempest-SnapshotDependencyTests-2122686831 None] Create snapshot completed successfully Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Flow 'volume_create_manager' (c68a6b1b-fdd9-4ffa-8740-00ac1f18dad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4690be60-ed11-4d63-8b9c-4fb6ab7adbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4690be60-ed11-4d63-8b9c-4fb6ab7adbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a33e5050-d165-4ef4-9d7a-0b903f80da1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1ebd57ddacc474687406801aaffadf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9aaefd45-1ffc-4022-a0f1-e4b9375b6f04,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:20Z,use_quota=True,user_id='d5f1b9c3a3fd4d2dbfa176876b7ec79c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b586b92b-24e5-42f6-b222-cafae143373c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b586b92b-24e5-42f6-b222-cafae143373c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b3ada8e-da7b-40c5-830c-26427b92286d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b3ada8e-da7b-40c5-830c-26427b92286d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a33e5050-d165-4ef4-9d7a-0b903f80da1a', 'volume_name': 'volume-a33e5050-d165-4ef4-9d7a-0b903f80da1a', 'volume_size': 1, 'snapshot_id': '9aaefd45-1ffc-4022-a0f1-e4b9375b6f04'}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf3b532-71ad-45e0-8253-7ac22ca711f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf3b532-71ad-45e0-8253-7ac22ca711f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16b91d4-9bc0-49dd-8a73-f48d107eb0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:20 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Volume a33e5050-d165-4ef4-9d7a-0b903f80da1a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a33e5050-d165-4ef4-9d7a-0b903f80da1a', 'volume_size': 1, 'snapshot_id': '9aaefd45-1ffc-4022-a0f1-e4b9375b6f04'} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Acquiring lock "cinder-quobyte-9aaefd45-1ffc-4022-a0f1-e4b9375b6f04-a33e5050-d165-4ef4-9d7a-0b903f80da1a" by "_create_volume_from_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Lock "cinder-quobyte-9aaefd45-1ffc-4022-a0f1-e4b9375b6f04-a33e5050-d165-4ef4-9d7a-0b903f80da1a" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Creating volume a33e5050-d165-4ef4-9d7a-0b903f80da1a from snapshot 9aaefd45-1ffc-4022-a0f1-e4b9375b6f04 {{(pid=81938) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Acquiring lock "cinder-quobyte-a33e5050-d165-4ef4-9d7a-0b903f80da1a" by "_copy_volume_from_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Lock "cinder-quobyte-a33e5050-d165-4ef4-9d7a-0b903f80da1a" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] snapshot: 9aaefd45-1ffc-4022-a0f1-e4b9375b6f04, volume: a33e5050-d165-4ef4-9d7a-0b903f80da1a, {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7044d9c-1bde-4355-88c1-f9eb42dd921b]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7.9aaefd45-1ffc-4022-a0f1-e4b9375b6f04 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:20 devstack sudo[88911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7.9aaefd45-1ffc-4022-a0f1-e4b9375b6f04 Apr 10 10:41:20 devstack sudo[88911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:20 devstack sudo[88911]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7.9aaefd45-1ffc-4022-a0f1-e4b9375b6f04" returned: 0 in 0.493s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7 {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Creating direct copy from snapshot {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c28019b-348f-4c40-ac3c-59e17d1d2ecf]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:21 devstack sudo[88916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7 Apr 10 10:41:21 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:21 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7" returned: 0 in 0.582s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:21 devstack cinder-volume[81938]: DEBUG cinder.utils [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Path /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a33e5050-d165-4ef4-9d7a-0b903f80da1a not found in is_blk_device check {{(pid=81938) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:41:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a33e5050-d165-4ef4-9d7a-0b903f80da1a {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:21 devstack sudo[88921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a33e5050-d165-4ef4-9d7a-0b903f80da1a Apr 10 10:41:21 devstack sudo[88921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:23 devstack sudo[88921]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a33e5050-d165-4ef4-9d7a-0b903f80da1a" returned: 0 in 2.454s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:24 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1175e54-1530-4399-b6a8-ae1ddc35a392]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:24 devstack sudo[88934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7 Apr 10 10:41:24 devstack sudo[88934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:24 devstack sudo[88934]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7" returned: 0 in 0.703s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:24 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7, size 1024.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a33e5050-d165-4ef4-9d7a-0b903f80da1a {{(pid=81938) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:41:24 devstack cinder-volume[81938]: INFO cinder.image.image_utils [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Converted 1024.00 MB image at 417.10 MB/s Apr 10 10:41:24 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a33e5050-d165-4ef4-9d7a-0b903f80da1a is being set with open permissions: ugo+rw Apr 10 10:41:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a33e5050-d165-4ef4-9d7a-0b903f80da1a {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:24 devstack sudo[88939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a33e5050-d165-4ef4-9d7a-0b903f80da1a Apr 10 10:41:24 devstack sudo[88939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:25 devstack sudo[88939]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a33e5050-d165-4ef4-9d7a-0b903f80da1a" returned: 0 in 0.467s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Lock "cinder-quobyte-a33e5050-d165-4ef4-9d7a-0b903f80da1a" released by "_copy_volume_from_snapshot" :: held 4.765s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Lock "cinder-quobyte-9aaefd45-1ffc-4022-a0f1-e4b9375b6f04-a33e5050-d165-4ef4-9d7a-0b903f80da1a" released by "_create_volume_from_snapshot" :: held 4.783s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.794s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16b91d4-9bc0-49dd-8a73-f48d107eb0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a33e5050-d165-4ef4-9d7a-0b903f80da1a', 'volume_size': 1, 'snapshot_id': '9aaefd45-1ffc-4022-a0f1-e4b9375b6f04'}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d17f0f-73f1-4be3-9c61-c61231329738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:25 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Volume volume-a33e5050-d165-4ef4-9d7a-0b903f80da1a (a33e5050-d165-4ef4-9d7a-0b903f80da1a): created successfully Apr 10 10:41:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d17f0f-73f1-4be3-9c61-c61231329738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Flow 'volume_create_manager' (c68a6b1b-fdd9-4ffa-8740-00ac1f18dad1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:25 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-98d79c8a-9064-42c1-9cfe-271b29f24a99 tempest-SnapshotDependencyTests-2122686831 None] Created volume successfully. Apr 10 10:41:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b40b26a1-f091-4632-bc0d-e64fdd1670b1 tempest-SnapshotDependencyTests-2122686831 None] Acquiring lock "cinder-9aaefd45-1ffc-4022-a0f1-e4b9375b6f04-delete_snapshot" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b40b26a1-f091-4632-bc0d-e64fdd1670b1 tempest-SnapshotDependencyTests-2122686831 None] Lock "cinder-9aaefd45-1ffc-4022-a0f1-e4b9375b6f04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b40b26a1-f091-4632-bc0d-e64fdd1670b1 tempest-SnapshotDependencyTests-2122686831 None] Acquiring lock "cinder-quobyte-f351c0d6-2a4f-4be3-9309-b5eba942fce7" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b40b26a1-f091-4632-bc0d-e64fdd1670b1 tempest-SnapshotDependencyTests-2122686831 None] Lock "cinder-quobyte-f351c0d6-2a4f-4be3-9309-b5eba942fce7" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b40b26a1-f091-4632-bc0d-e64fdd1670b1 tempest-SnapshotDependencyTests-2122686831 None] Acquiring lock "cinder-quobyte-9aaefd45-1ffc-4022-a0f1-e4b9375b6f04" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:25 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b40b26a1-f091-4632-bc0d-e64fdd1670b1 tempest-SnapshotDependencyTests-2122686831 None] Lock "cinder-quobyte-9aaefd45-1ffc-4022-a0f1-e4b9375b6f04" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-b40b26a1-f091-4632-bc0d-e64fdd1670b1 tempest-SnapshotDependencyTests-2122686831 None] Deleting offline snapshot 9aaefd45-1ffc-4022-a0f1-e4b9375b6f04 of volume f351c0d6-2a4f-4be3-9309-b5eba942fce7 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:41:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-b40b26a1-f091-4632-bc0d-e64fdd1670b1 tempest-SnapshotDependencyTests-2122686831 None] snapshot_file for this snap is: volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7.9aaefd45-1ffc-4022-a0f1-e4b9375b6f04 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:41:25 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed37480-46ea-4490-aaff-fbad48905615]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b40b26a1-f091-4632-bc0d-e64fdd1670b1 tempest-SnapshotDependencyTests-2122686831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7.9aaefd45-1ffc-4022-a0f1-e4b9375b6f04 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:26 devstack sudo[88942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7.9aaefd45-1ffc-4022-a0f1-e4b9375b6f04 Apr 10 10:41:26 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:26 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b40b26a1-f091-4632-bc0d-e64fdd1670b1 tempest-SnapshotDependencyTests-2122686831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7.9aaefd45-1ffc-4022-a0f1-e4b9375b6f04" returned: 0 in 0.492s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:26 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-b40b26a1-f091-4632-bc0d-e64fdd1670b1 tempest-SnapshotDependencyTests-2122686831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:41:26 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5e4926-c30c-44ad-94c7-2ebc23a8e876]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b40b26a1-f091-4632-bc0d-e64fdd1670b1 tempest-SnapshotDependencyTests-2122686831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:26 devstack sudo[88947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7 Apr 10 10:41:26 devstack sudo[88947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:26 devstack sudo[88947]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b40b26a1-f091-4632-bc0d-e64fdd1670b1 tempest-SnapshotDependencyTests-2122686831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7" returned: 0 in 0.517s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b40b26a1-f091-4632-bc0d-e64fdd1670b1 tempest-SnapshotDependencyTests-2122686831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7.9aaefd45-1ffc-4022-a0f1-e4b9375b6f04 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:26 devstack sudo[88952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7.9aaefd45-1ffc-4022-a0f1-e4b9375b6f04 Apr 10 10:41:26 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:27 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b40b26a1-f091-4632-bc0d-e64fdd1670b1 tempest-SnapshotDependencyTests-2122686831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7.9aaefd45-1ffc-4022-a0f1-e4b9375b6f04" returned: 0 in 0.508s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b40b26a1-f091-4632-bc0d-e64fdd1670b1 tempest-SnapshotDependencyTests-2122686831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7.9aaefd45-1ffc-4022-a0f1-e4b9375b6f04 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:27 devstack sudo[88957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7.9aaefd45-1ffc-4022-a0f1-e4b9375b6f04 Apr 10 10:41:27 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:27 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b40b26a1-f091-4632-bc0d-e64fdd1670b1 tempest-SnapshotDependencyTests-2122686831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7.9aaefd45-1ffc-4022-a0f1-e4b9375b6f04" returned: 0 in 0.417s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:27 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b40b26a1-f091-4632-bc0d-e64fdd1670b1 tempest-SnapshotDependencyTests-2122686831 None] Lock "cinder-quobyte-9aaefd45-1ffc-4022-a0f1-e4b9375b6f04" released by "_delete_snapshot" :: held 1.989s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:27 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b40b26a1-f091-4632-bc0d-e64fdd1670b1 tempest-SnapshotDependencyTests-2122686831 None] Lock "cinder-quobyte-f351c0d6-2a4f-4be3-9309-b5eba942fce7" released by "delete_snapshot" :: held 2.003s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:27 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-b40b26a1-f091-4632-bc0d-e64fdd1670b1 tempest-SnapshotDependencyTests-2122686831 None] Created reservations ['a3095e60-fc7c-4c36-b18b-3d23dc703b05', '013e2445-7308-41c4-9c65-7900e9450f24', '2320df6d-e0f2-4d15-a9c6-b0fdcb5783fe', '74fdf649-620f-4940-bd48-8b56a5479f78'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:27 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-b40b26a1-f091-4632-bc0d-e64fdd1670b1 tempest-SnapshotDependencyTests-2122686831 None] Delete snapshot completed successfully. Apr 10 10:41:27 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b40b26a1-f091-4632-bc0d-e64fdd1670b1 tempest-SnapshotDependencyTests-2122686831 None] Lock "cinder-9aaefd45-1ffc-4022-a0f1-e4b9375b6f04-delete_snapshot" released by "delete_snapshot" :: held 2.097s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:29 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-2c844927-3e90-4adb-b4ea-59865b01d41d tempest-SnapshotDependencyTests-2122686831 None] Acquiring lock "cinder-f351c0d6-2a4f-4be3-9309-b5eba942fce7-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:29 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-2c844927-3e90-4adb-b4ea-59865b01d41d tempest-SnapshotDependencyTests-2122686831 None] Lock "cinder-f351c0d6-2a4f-4be3-9309-b5eba942fce7-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:29 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-2c844927-3e90-4adb-b4ea-59865b01d41d tempest-SnapshotDependencyTests-2122686831 None] Acquiring lock "cinder-quobyte-f351c0d6-2a4f-4be3-9309-b5eba942fce7" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:29 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-2c844927-3e90-4adb-b4ea-59865b01d41d tempest-SnapshotDependencyTests-2122686831 None] Lock "cinder-quobyte-f351c0d6-2a4f-4be3-9309-b5eba942fce7" acquired by "delete_volume" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:29 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4bb549-10d0-4239-87ea-b9f1b9f3c114]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2c844927-3e90-4adb-b4ea-59865b01d41d tempest-SnapshotDependencyTests-2122686831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:29 devstack sudo[88960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7 Apr 10 10:41:29 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:29 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2c844927-3e90-4adb-b4ea-59865b01d41d tempest-SnapshotDependencyTests-2122686831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7" returned: 0 in 0.506s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2c844927-3e90-4adb-b4ea-59865b01d41d tempest-SnapshotDependencyTests-2122686831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:29 devstack sudo[88965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7 Apr 10 10:41:29 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:30 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2c844927-3e90-4adb-b4ea-59865b01d41d tempest-SnapshotDependencyTests-2122686831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-f351c0d6-2a4f-4be3-9309-b5eba942fce7" returned: 0 in 0.457s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:30 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-2c844927-3e90-4adb-b4ea-59865b01d41d tempest-SnapshotDependencyTests-2122686831 None] Lock "cinder-quobyte-f351c0d6-2a4f-4be3-9309-b5eba942fce7" released by "delete_volume" :: held 1.004s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:30 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-2c844927-3e90-4adb-b4ea-59865b01d41d tempest-SnapshotDependencyTests-2122686831 None] Created reservations ['74d839ce-da6b-4954-b836-0f8d48c72aeb', 'cf96a4f9-3d37-4972-9ca4-3739fcc62553', 'c7bc52db-1d98-4f06-bb6f-96e9d11f41d4', 'bbe6dc62-338b-4811-a20f-164d68705082'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-2c844927-3e90-4adb-b4ea-59865b01d41d tempest-SnapshotDependencyTests-2122686831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-2c844927-3e90-4adb-b4ea-59865b01d41d tempest-SnapshotDependencyTests-2122686831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:30 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-2c844927-3e90-4adb-b4ea-59865b01d41d tempest-SnapshotDependencyTests-2122686831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:30 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-2c844927-3e90-4adb-b4ea-59865b01d41d tempest-SnapshotDependencyTests-2122686831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-2c844927-3e90-4adb-b4ea-59865b01d41d tempest-SnapshotDependencyTests-2122686831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2c844927-3e90-4adb-b4ea-59865b01d41d tempest-SnapshotDependencyTests-2122686831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:30 devstack sudo[88969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:41:30 devstack sudo[88969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:30 devstack sudo[88969]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2c844927-3e90-4adb-b4ea-59865b01d41d tempest-SnapshotDependencyTests-2122686831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.420s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:30 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-2c844927-3e90-4adb-b4ea-59865b01d41d tempest-SnapshotDependencyTests-2122686831 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:30 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-2c844927-3e90-4adb-b4ea-59865b01d41d tempest-SnapshotDependencyTests-2122686831 None] Deleted volume successfully. Apr 10 10:41:30 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-2c844927-3e90-4adb-b4ea-59865b01d41d tempest-SnapshotDependencyTests-2122686831 None] Lock "cinder-f351c0d6-2a4f-4be3-9309-b5eba942fce7-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:31 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-81207f55-f170-49a3-ad60-f23907e70454 tempest-SnapshotDependencyTests-2122686831 None] Acquiring lock "cinder-a33e5050-d165-4ef4-9d7a-0b903f80da1a-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:31 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-81207f55-f170-49a3-ad60-f23907e70454 tempest-SnapshotDependencyTests-2122686831 None] Lock "cinder-a33e5050-d165-4ef4-9d7a-0b903f80da1a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:31 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-81207f55-f170-49a3-ad60-f23907e70454 tempest-SnapshotDependencyTests-2122686831 None] Acquiring lock "cinder-quobyte-a33e5050-d165-4ef4-9d7a-0b903f80da1a" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:31 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-81207f55-f170-49a3-ad60-f23907e70454 tempest-SnapshotDependencyTests-2122686831 None] Lock "cinder-quobyte-a33e5050-d165-4ef4-9d7a-0b903f80da1a" acquired by "delete_volume" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:31 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[d981bf2a-142f-4d0f-8289-5881f7b70701]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-81207f55-f170-49a3-ad60-f23907e70454 tempest-SnapshotDependencyTests-2122686831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a33e5050-d165-4ef4-9d7a-0b903f80da1a {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:31 devstack sudo[88974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a33e5050-d165-4ef4-9d7a-0b903f80da1a Apr 10 10:41:31 devstack sudo[88974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:31 devstack sudo[88974]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-81207f55-f170-49a3-ad60-f23907e70454 tempest-SnapshotDependencyTests-2122686831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a33e5050-d165-4ef4-9d7a-0b903f80da1a" returned: 0 in 0.502s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:31 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-81207f55-f170-49a3-ad60-f23907e70454 tempest-SnapshotDependencyTests-2122686831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a33e5050-d165-4ef4-9d7a-0b903f80da1a {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:31 devstack sudo[88979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a33e5050-d165-4ef4-9d7a-0b903f80da1a Apr 10 10:41:31 devstack sudo[88979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:32 devstack sudo[88979]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-81207f55-f170-49a3-ad60-f23907e70454 tempest-SnapshotDependencyTests-2122686831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-a33e5050-d165-4ef4-9d7a-0b903f80da1a" returned: 0 in 0.453s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:32 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-81207f55-f170-49a3-ad60-f23907e70454 tempest-SnapshotDependencyTests-2122686831 None] Lock "cinder-quobyte-a33e5050-d165-4ef4-9d7a-0b903f80da1a" released by "delete_volume" :: held 0.980s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:32 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-81207f55-f170-49a3-ad60-f23907e70454 tempest-SnapshotDependencyTests-2122686831 None] Created reservations ['ae2dc233-dd2c-4f4b-88fc-774efdfaa953', 'abbc21d2-06a8-44f1-83ab-bf2ad5c7c00b', 'b5e19923-4d9b-4278-8a28-59927a216c80', '3440aa19-9e6d-4da4-842c-920f761caefe'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-81207f55-f170-49a3-ad60-f23907e70454 tempest-SnapshotDependencyTests-2122686831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-81207f55-f170-49a3-ad60-f23907e70454 tempest-SnapshotDependencyTests-2122686831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:32 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-81207f55-f170-49a3-ad60-f23907e70454 tempest-SnapshotDependencyTests-2122686831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:32 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-81207f55-f170-49a3-ad60-f23907e70454 tempest-SnapshotDependencyTests-2122686831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-81207f55-f170-49a3-ad60-f23907e70454 tempest-SnapshotDependencyTests-2122686831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-81207f55-f170-49a3-ad60-f23907e70454 tempest-SnapshotDependencyTests-2122686831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:32 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:41:32 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:32 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-81207f55-f170-49a3-ad60-f23907e70454 tempest-SnapshotDependencyTests-2122686831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.421s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:32 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-81207f55-f170-49a3-ad60-f23907e70454 tempest-SnapshotDependencyTests-2122686831 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:32 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-81207f55-f170-49a3-ad60-f23907e70454 tempest-SnapshotDependencyTests-2122686831 None] Deleted volume successfully. Apr 10 10:41:32 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-81207f55-f170-49a3-ad60-f23907e70454 tempest-SnapshotDependencyTests-2122686831 None] Lock "cinder-a33e5050-d165-4ef4-9d7a-0b903f80da1a-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:42 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writing DB stats cinder:SELECT=31,cinder:UPDATE=38,cinder:DELETE=1,cinder:INSERT=5 {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:41:42 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writing DB stats cinder:SELECT=16,cinder:INSERT=9,cinder:UPDATE=18,cinder:DELETE=4 {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Flow 'volume_create_manager' (bc08b9c2-e46e-49c8-a30f-58704b8fcbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b573439-087c-4e7f-8506-2e29472b505d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b573439-087c-4e7f-8506-2e29472b505d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1627585415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e057fb64-b0ff-4cb9-9b69-e40140ca4a79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f04d6ace1945009b5b39b99bd0f2b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:46Z,use_quota=True,user_id='6d41f99b92eb4835b48e237cd6187482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5122e245-4340-46e9-9cee-455d012f05f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5122e245-4340-46e9-9cee-455d012f05f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a207c351-392c-4f37-ba24-7c831c534134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a207c351-392c-4f37-ba24-7c831c534134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e057fb64-b0ff-4cb9-9b69-e40140ca4a79', 'volume_name': 'volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ac9e3f-320b-4d3c-823a-1b57d5d137a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ac9e3f-320b-4d3c-823a-1b57d5d137a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e93aee-6bae-4eb5-a2eb-b17c8a89a143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Volume e057fb64-b0ff-4cb9-9b69-e40140ca4a79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79', 'volume_size': 1} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1627585415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e057fb64-b0ff-4cb9-9b69-e40140ca4a79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f04d6ace1945009b5b39b99bd0f2b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:46Z,use_quota=True,user_id='6d41f99b92eb4835b48e237cd6187482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Creating volume e057fb64-b0ff-4cb9-9b69-e40140ca4a79 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:46 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:46 devstack sudo[89030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79 1073741824 Apr 10 10:41:46 devstack sudo[89030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] Flow 'volume_create_manager' (2c578ed2-e154-4916-a0ee-45fa8e36ec53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce5c45a6-fb6a-4164-a2e7-5ce4b651a664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce5c45a6-fb6a-4164-a2e7-5ce4b651a664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-947771634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63115af-eb5d-4759-b619-837e6410d69b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6afc05ad9f4cf4bc40bf8a9d808a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:46Z,use_quota=True,user_id='c8aadf967b454cd4a01fdbb3c8af4eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35cd77b6-6cf1-4366-b5d1-2b7802ea20d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35cd77b6-6cf1-4366-b5d1-2b7802ea20d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bced5f9a-370c-403c-8a9a-f1fa9b82c098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bced5f9a-370c-403c-8a9a-f1fa9b82c098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd63115af-eb5d-4759-b619-837e6410d69b', 'volume_name': 'volume-d63115af-eb5d-4759-b619-837e6410d69b', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2e4b889-ea5b-4f62-a5b0-a01396f7a40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2e4b889-ea5b-4f62-a5b0-a01396f7a40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49c33351-9f02-4ad7-9351-e291e39f045d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] Volume d63115af-eb5d-4759-b619-837e6410d69b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d63115af-eb5d-4759-b619-837e6410d69b', 'volume_size': 1} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] Flow 'volume_create_manager' (719eefde-ae84-49c6-9095-bb4b43419184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208c06c3-9dee-41f1-b969-0a9212570cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208c06c3-9dee-41f1-b969-0a9212570cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-468789058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a78b455-89df-4117-aaa8-5c2901d5144d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f270f4de02f476fac3ad759b5c0e75f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:46Z,use_quota=True,user_id='63fbc81099794683a95d08b5b17d020d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b2fbffa-c839-4008-b331-93ace204c737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b2fbffa-c839-4008-b331-93ace204c737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d07889-fedd-4c14-946c-55e65c690fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d07889-fedd-4c14-946c-55e65c690fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a78b455-89df-4117-aaa8-5c2901d5144d', 'volume_name': 'volume-7a78b455-89df-4117-aaa8-5c2901d5144d', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1898aa-2546-425c-b656-a32d3dcae523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1898aa-2546-425c-b656-a32d3dcae523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcdcdd54-8bee-417b-a0e7-5b24e08de131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] Volume 7a78b455-89df-4117-aaa8-5c2901d5144d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a78b455-89df-4117-aaa8-5c2901d5144d', 'volume_size': 1} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Flow 'volume_create_manager' (037e25b5-a65d-450c-b103-3b164a9dd6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf2c7b96-c29d-4186-909c-c31f40045adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf2c7b96-c29d-4186-909c-c31f40045adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1183697638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdea615c-08f6-411b-b475-b3ea58da510f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f983b221144642965612251a64f3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:46Z,use_quota=True,user_id='b8374366ca5245d7b0e245c9ed22a313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6975a68c-76ab-43ce-8a43-0c04cf3e2c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6975a68c-76ab-43ce-8a43-0c04cf3e2c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bba3570-77e6-4120-ace5-63e0960b6b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bba3570-77e6-4120-ace5-63e0960b6b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdea615c-08f6-411b-b475-b3ea58da510f', 'volume_name': 'volume-cdea615c-08f6-411b-b475-b3ea58da510f', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b612ea3-3af3-4774-ac01-861ee1ae2e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b612ea3-3af3-4774-ac01-861ee1ae2e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af51d5d-1942-42a4-8633-27b512e33bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Volume cdea615c-08f6-411b-b475-b3ea58da510f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdea615c-08f6-411b-b475-b3ea58da510f', 'volume_size': 1} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] Flow 'volume_create_manager' (e9221b29-b572-4522-a3d5-d4bfdeffa32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d761c51c-7b7f-4bfc-8c75-ad5d9ff7e1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d761c51c-7b7f-4bfc-8c75-ad5d9ff7e1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1962407922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b2f6c1-981b-4aa8-9ccd-2b8cdc91aaf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6afc05ad9f4cf4bc40bf8a9d808a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:46Z,use_quota=True,user_id='c8aadf967b454cd4a01fdbb3c8af4eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72e54188-061e-433a-8bb9-367d2defd0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72e54188-061e-433a-8bb9-367d2defd0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e57ad0d5-4fe4-49e2-9342-a93813f11466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e57ad0d5-4fe4-49e2-9342-a93813f11466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05b2f6c1-981b-4aa8-9ccd-2b8cdc91aaf2', 'volume_name': 'volume-05b2f6c1-981b-4aa8-9ccd-2b8cdc91aaf2', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4201748c-30ae-49d1-9e48-afa299df9f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4201748c-30ae-49d1-9e48-afa299df9f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c851138e-81d2-4f01-b216-9cc1c37723e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] Volume 05b2f6c1-981b-4aa8-9ccd-2b8cdc91aaf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05b2f6c1-981b-4aa8-9ccd-2b8cdc91aaf2', 'volume_size': 1} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] Flow 'volume_create_manager' (303f6be6-1a7b-4289-a04b-560bc79907b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222631e4-cf2c-4817-9561-9eafbb70d132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222631e4-cf2c-4817-9561-9eafbb70d132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1583666472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9149882-a372-4d06-91dc-43fafee5f7bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6afc05ad9f4cf4bc40bf8a9d808a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:47Z,use_quota=True,user_id='c8aadf967b454cd4a01fdbb3c8af4eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01090f1-cea5-4f0c-badc-29d3d5625a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01090f1-cea5-4f0c-badc-29d3d5625a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:46 devstack sudo[89030]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab2e421-9f32-42e3-9829-5472109060e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab2e421-9f32-42e3-9829-5472109060e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9149882-a372-4d06-91dc-43fafee5f7bb', 'volume_name': 'volume-d9149882-a372-4d06-91dc-43fafee5f7bb', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b799861d-cd71-440b-b759-1919e673978d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b799861d-cd71-440b-b759-1919e673978d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff8da6e4-9200-446b-b5c1-01fd30fb0584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] Volume d9149882-a372-4d06-91dc-43fafee5f7bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9149882-a372-4d06-91dc-43fafee5f7bb', 'volume_size': 1} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79 1073741824" returned: 0 in 0.660s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:46 devstack sudo[89035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79 Apr 10 10:41:46 devstack sudo[89035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] Flow 'volume_create_manager' (ce9d90e1-e3d1-4f25-aee7-d1070a7dd4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f641f961-f01e-42d8-a61d-33c9b613e21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f641f961-f01e-42d8-a61d-33c9b613e21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1848395645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a231102-472e-4800-9339-be7729ab404f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6afc05ad9f4cf4bc40bf8a9d808a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:47Z,use_quota=True,user_id='c8aadf967b454cd4a01fdbb3c8af4eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a14dae8f-1486-4b69-a6ea-504c94e4c71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a14dae8f-1486-4b69-a6ea-504c94e4c71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08686385-49c4-4591-8f8d-de8015167fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08686385-49c4-4591-8f8d-de8015167fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a231102-472e-4800-9339-be7729ab404f', 'volume_name': 'volume-7a231102-472e-4800-9339-be7729ab404f', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f4eb003-1fa1-40ab-8c31-6a3965e4cb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f4eb003-1fa1-40ab-8c31-6a3965e4cb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c71b5e3-d2d2-4d9a-8ea4-80bfd546f701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:46 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] Volume 7a231102-472e-4800-9339-be7729ab404f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a231102-472e-4800-9339-be7729ab404f', 'volume_size': 1} Apr 10 10:41:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:47 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] Flow 'volume_create_manager' (99077e43-a3b2-4633-af48-8b4e5f394926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a12511-bc64-49a9-a2d7-d7d7647af2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a12511-bc64-49a9-a2d7-d7d7647af2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-876983287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65cb2aeb-e317-459d-bfb1-3bd1c062b35a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6afc05ad9f4cf4bc40bf8a9d808a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:47Z,use_quota=True,user_id='c8aadf967b454cd4a01fdbb3c8af4eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd7dd377-a1fa-4a6e-ba42-157071ed4a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd7dd377-a1fa-4a6e-ba42-157071ed4a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a69b6214-88af-473a-81aa-560af5b6d10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a69b6214-88af-473a-81aa-560af5b6d10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65cb2aeb-e317-459d-bfb1-3bd1c062b35a', 'volume_name': 'volume-65cb2aeb-e317-459d-bfb1-3bd1c062b35a', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2caaecd4-8899-49b6-8eb8-1f5e6c934a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2caaecd4-8899-49b6-8eb8-1f5e6c934a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce22821-0505-4286-aecc-a8f6deb54110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:47 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] Volume 65cb2aeb-e317-459d-bfb1-3bd1c062b35a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65cb2aeb-e317-459d-bfb1-3bd1c062b35a', 'volume_size': 1} Apr 10 10:41:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:47 devstack sudo[89035]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79" returned: 0 in 0.430s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:47 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:41:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.010s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:47 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-947771634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63115af-eb5d-4759-b619-837e6410d69b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6afc05ad9f4cf4bc40bf8a9d808a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:46Z,use_quota=True,user_id='c8aadf967b454cd4a01fdbb3c8af4eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:41:47 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] Creating volume d63115af-eb5d-4759-b619-837e6410d69b {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:41:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:47 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:47 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:47 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:47 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:41:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d63115af-eb5d-4759-b619-837e6410d69b 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e93aee-6bae-4eb5-a2eb-b17c8a89a143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df9a9df-d025-470b-abe7-7becbcd9a1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:47 devstack sudo[89038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d63115af-eb5d-4759-b619-837e6410d69b 1073741824 Apr 10 10:41:47 devstack sudo[89038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:47 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Volume volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79 (e057fb64-b0ff-4cb9-9b69-e40140ca4a79): created successfully Apr 10 10:41:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df9a9df-d025-470b-abe7-7becbcd9a1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Flow 'volume_create_manager' (bc08b9c2-e46e-49c8-a30f-58704b8fcbee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:47 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-1dc10920-5597-47e7-aa01-18396412f710 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Created volume successfully. Apr 10 10:41:47 devstack sudo[89038]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d63115af-eb5d-4759-b619-837e6410d69b 1073741824" returned: 0 in 0.479s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d63115af-eb5d-4759-b619-837e6410d69b {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:47 devstack sudo[89043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d63115af-eb5d-4759-b619-837e6410d69b Apr 10 10:41:47 devstack sudo[89043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:48 devstack cinder-volume[81938]: DEBUG oslo_service.periodic_task [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81938) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:41:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:48 devstack sudo[89046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:41:48 devstack sudo[89046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:48 devstack sudo[89043]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d63115af-eb5d-4759-b619-837e6410d69b" returned: 0 in 0.421s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:41:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.734s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-468789058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a78b455-89df-4117-aaa8-5c2901d5144d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f270f4de02f476fac3ad759b5c0e75f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:46Z,use_quota=True,user_id='63fbc81099794683a95d08b5b17d020d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:41:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] Creating volume 7a78b455-89df-4117-aaa8-5c2901d5144d {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:41:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:48 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:41:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:48 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49c33351-9f02-4ad7-9351-e291e39f045d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d63115af-eb5d-4759-b619-837e6410d69b', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:48 devstack sudo[89048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d 1073741824 Apr 10 10:41:48 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:48 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d17d29d4-8b7e-4ae5-9561-78f80cc3e4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:48 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] Volume volume-d63115af-eb5d-4759-b619-837e6410d69b (d63115af-eb5d-4759-b619-837e6410d69b): created successfully Apr 10 10:41:48 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d17d29d4-8b7e-4ae5-9561-78f80cc3e4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:48 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] Flow 'volume_create_manager' (2c578ed2-e154-4916-a0ee-45fa8e36ec53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:48 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-82b5c4c4-6126-42b4-90e1-028f4ae63800 tempest-CreateVolumesFromImageTest-1560385012 None] Created volume successfully. Apr 10 10:41:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-4f69dabb-f832-4737-9efe-90f22ee35a48 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:48 devstack sudo[89046]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.519s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:48 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:48 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d 1073741824" returned: 0 in 0.517s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:48 devstack sudo[89054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d Apr 10 10:41:48 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:49 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d" returned: 0 in 0.396s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:49 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:41:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.570s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:49 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1183697638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdea615c-08f6-411b-b475-b3ea58da510f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f983b221144642965612251a64f3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:46Z,use_quota=True,user_id='b8374366ca5245d7b0e245c9ed22a313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:41:49 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Creating volume cdea615c-08f6-411b-b475-b3ea58da510f {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:41:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:49 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:49 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:49 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:49 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:41:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cdea615c-08f6-411b-b475-b3ea58da510f 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcdcdd54-8bee-417b-a0e7-5b24e08de131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a78b455-89df-4117-aaa8-5c2901d5144d', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd3fd17-b1b0-44f4-9c55-53a323c7c782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:49 devstack sudo[89063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cdea615c-08f6-411b-b475-b3ea58da510f 1073741824 Apr 10 10:41:49 devstack sudo[89063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:49 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] Volume volume-7a78b455-89df-4117-aaa8-5c2901d5144d (7a78b455-89df-4117-aaa8-5c2901d5144d): created successfully Apr 10 10:41:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd3fd17-b1b0-44f4-9c55-53a323c7c782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:49 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] Flow 'volume_create_manager' (719eefde-ae84-49c6-9095-bb4b43419184) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:49 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-a87ff92d-d0ff-44e4-80a2-ab29d5e0e0fe tempest-VolumeDependencyTests-421615573 None] Created volume successfully. Apr 10 10:41:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d57b01d2-8b0d-422b-89e8-dc42018e1290 tempest-VolumeDependencyTests-421615573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:49 devstack sudo[89063]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cdea615c-08f6-411b-b475-b3ea58da510f 1073741824" returned: 0 in 0.528s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cdea615c-08f6-411b-b475-b3ea58da510f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:49 devstack sudo[89068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cdea615c-08f6-411b-b475-b3ea58da510f Apr 10 10:41:49 devstack sudo[89068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:50 devstack sudo[89068]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cdea615c-08f6-411b-b475-b3ea58da510f" returned: 0 in 0.395s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:50 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:41:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.430s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:50 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1962407922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b2f6c1-981b-4aa8-9ccd-2b8cdc91aaf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6afc05ad9f4cf4bc40bf8a9d808a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:46Z,use_quota=True,user_id='c8aadf967b454cd4a01fdbb3c8af4eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:41:50 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] Creating volume 05b2f6c1-981b-4aa8-9ccd-2b8cdc91aaf2 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:41:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:50 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:50 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:50 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:50 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:41:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-05b2f6c1-981b-4aa8-9ccd-2b8cdc91aaf2 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af51d5d-1942-42a4-8633-27b512e33bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdea615c-08f6-411b-b475-b3ea58da510f', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4da3380-2f95-43a3-8510-83cb8484ca85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:50 devstack sudo[89072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-05b2f6c1-981b-4aa8-9ccd-2b8cdc91aaf2 1073741824 Apr 10 10:41:50 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:50 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Volume volume-cdea615c-08f6-411b-b475-b3ea58da510f (cdea615c-08f6-411b-b475-b3ea58da510f): created successfully Apr 10 10:41:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4da3380-2f95-43a3-8510-83cb8484ca85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Flow 'volume_create_manager' (037e25b5-a65d-450c-b103-3b164a9dd6b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:50 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-66cf98b4-8976-4c2a-a09d-1fe6ea866376 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Created volume successfully. Apr 10 10:41:50 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-05b2f6c1-981b-4aa8-9ccd-2b8cdc91aaf2 1073741824" returned: 0 in 0.499s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-05b2f6c1-981b-4aa8-9ccd-2b8cdc91aaf2 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:50 devstack sudo[89077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-05b2f6c1-981b-4aa8-9ccd-2b8cdc91aaf2 Apr 10 10:41:50 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:50 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Flow 'volume_create_manager' (557bcd7d-2fa3-4f61-a1b1-673eaaf07bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe5577a-8e13-4fdc-b263-377ff4119947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe5577a-8e13-4fdc-b263-377ff4119947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-60214453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e05ea640-c9b4-4c50-95c7-a3c152f59894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f983b221144642965612251a64f3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:51Z,use_quota=True,user_id='b8374366ca5245d7b0e245c9ed22a313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea5dc71e-f023-4d75-9d63-afb9509df8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea5dc71e-f023-4d75-9d63-afb9509df8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a382fe-d4e1-4195-afdd-f2f76b1da630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a382fe-d4e1-4195-afdd-f2f76b1da630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e05ea640-c9b4-4c50-95c7-a3c152f59894', 'volume_name': 'volume-e05ea640-c9b4-4c50-95c7-a3c152f59894', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5066ccf5-b2b3-47c4-a04c-8960d3091004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5066ccf5-b2b3-47c4-a04c-8960d3091004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:50 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e08eb2e1-058d-489d-aa3c-11de57268e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:50 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Volume e05ea640-c9b4-4c50-95c7-a3c152f59894: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e05ea640-c9b4-4c50-95c7-a3c152f59894', 'volume_size': 1} Apr 10 10:41:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:51 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-05b2f6c1-981b-4aa8-9ccd-2b8cdc91aaf2" returned: 0 in 0.473s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.295s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1583666472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9149882-a372-4d06-91dc-43fafee5f7bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6afc05ad9f4cf4bc40bf8a9d808a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:47Z,use_quota=True,user_id='c8aadf967b454cd4a01fdbb3c8af4eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] Creating volume d9149882-a372-4d06-91dc-43fafee5f7bb {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:51 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d9149882-a372-4d06-91dc-43fafee5f7bb 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:51 devstack sudo[89080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d9149882-a372-4d06-91dc-43fafee5f7bb 1073741824 Apr 10 10:41:51 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c851138e-81d2-4f01-b216-9cc1c37723e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05b2f6c1-981b-4aa8-9ccd-2b8cdc91aaf2', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c05b189b-a35f-43e4-b5a7-430171767866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Flow 'volume_create_manager' (e591b39e-05e7-46e5-b9f9-c137c9cbb8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8995c9e-b74f-45a6-946d-f07d531e2037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8995c9e-b74f-45a6-946d-f07d531e2037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1489872481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acbaed7c-223c-47dd-82bc-5c2f84183796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f983b221144642965612251a64f3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:51Z,use_quota=True,user_id='b8374366ca5245d7b0e245c9ed22a313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3c44f6c-fb86-4269-a52f-e76d94dc02f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3c44f6c-fb86-4269-a52f-e76d94dc02f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f5fe0d-a63d-4c8a-95ad-d0e6e55e37d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f5fe0d-a63d-4c8a-95ad-d0e6e55e37d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acbaed7c-223c-47dd-82bc-5c2f84183796', 'volume_name': 'volume-acbaed7c-223c-47dd-82bc-5c2f84183796', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6395b57-da15-418b-9532-221f25c58f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6395b57-da15-418b-9532-221f25c58f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc601e2-387f-433f-a35b-ac4b4f737175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:51 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Volume acbaed7c-223c-47dd-82bc-5c2f84183796: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acbaed7c-223c-47dd-82bc-5c2f84183796', 'volume_size': 1} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:51 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] Volume volume-05b2f6c1-981b-4aa8-9ccd-2b8cdc91aaf2 (05b2f6c1-981b-4aa8-9ccd-2b8cdc91aaf2): created successfully Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c05b189b-a35f-43e4-b5a7-430171767866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] Flow 'volume_create_manager' (e9221b29-b572-4522-a3d5-d4bfdeffa32f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:51 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-83f5c834-6062-4864-bd05-63f8b4f34981 tempest-CreateVolumesFromImageTest-1560385012 None] Created volume successfully. Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Flow 'volume_create_manager' (11852313-30f0-47de-a433-9ab8d6ecb39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba4c9f71-5870-4ba2-a4e3-48639a289f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba4c9f71-5870-4ba2-a4e3-48639a289f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1120498029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d463964b-0c97-4bbc-bafe-91da4f094cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f983b221144642965612251a64f3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:51Z,use_quota=True,user_id='b8374366ca5245d7b0e245c9ed22a313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269f761c-5ed6-491f-be22-79942781a290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269f761c-5ed6-491f-be22-79942781a290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c8e7747-c1e8-473f-99dc-156dcb9dbde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c8e7747-c1e8-473f-99dc-156dcb9dbde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd463964b-0c97-4bbc-bafe-91da4f094cb5', 'volume_name': 'volume-d463964b-0c97-4bbc-bafe-91da4f094cb5', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f774de97-3bb6-48c5-87a1-e2daf0abc7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f774de97-3bb6-48c5-87a1-e2daf0abc7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c1ed560-2040-49ef-a2cb-bfea60f31504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:51 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Volume d463964b-0c97-4bbc-bafe-91da4f094cb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d463964b-0c97-4bbc-bafe-91da4f094cb5', 'volume_size': 1} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Flow 'volume_create_manager' (d9142a84-e4b2-4bcf-9f4a-8b375e0d52a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (041bae75-e72e-42c1-8bf0-7da7f008056c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (041bae75-e72e-42c1-8bf0-7da7f008056c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-436567417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ec363f1-6f00-49d7-981d-a74238081e47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f983b221144642965612251a64f3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:51Z,use_quota=True,user_id='b8374366ca5245d7b0e245c9ed22a313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f6fbb18-b110-497a-a7f4-3ca6d65569bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f6fbb18-b110-497a-a7f4-3ca6d65569bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8c24068-8ea2-448c-b2bf-1e21062950a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8c24068-8ea2-448c-b2bf-1e21062950a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ec363f1-6f00-49d7-981d-a74238081e47', 'volume_name': 'volume-6ec363f1-6f00-49d7-981d-a74238081e47', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14ae292c-7e15-4e4d-9720-66835ec757f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14ae292c-7e15-4e4d-9720-66835ec757f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a368b12d-8fc2-4dcc-a4c4-b016391307cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:51 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Volume 6ec363f1-6f00-49d7-981d-a74238081e47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ec363f1-6f00-49d7-981d-a74238081e47', 'volume_size': 1} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:51 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d9149882-a372-4d06-91dc-43fafee5f7bb 1073741824" returned: 0 in 0.621s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d9149882-a372-4d06-91dc-43fafee5f7bb {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:51 devstack sudo[89085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d9149882-a372-4d06-91dc-43fafee5f7bb Apr 10 10:41:51 devstack sudo[89085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Flow 'volume_create_manager' (e5efce09-0039-47e0-9c99-67150829cc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949280a8-1009-4e1f-af01-b83e8a4f7910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949280a8-1009-4e1f-af01-b83e8a4f7910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1152730247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c241eb-0a49-4645-8656-93ade2b89e4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f983b221144642965612251a64f3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:52Z,use_quota=True,user_id='b8374366ca5245d7b0e245c9ed22a313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad20271-0192-42a8-9f78-15dd3faa410f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad20271-0192-42a8-9f78-15dd3faa410f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a96717f-a6b8-4a18-8419-62a4bb8b4b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a96717f-a6b8-4a18-8419-62a4bb8b4b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60c241eb-0a49-4645-8656-93ade2b89e4a', 'volume_name': 'volume-60c241eb-0a49-4645-8656-93ade2b89e4a', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3154ae0-c951-4300-886d-3a0bdf9d35c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3154ae0-c951-4300-886d-3a0bdf9d35c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d473f0-9d23-412b-830c-36f14fd49f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:51 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Volume 60c241eb-0a49-4645-8656-93ade2b89e4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60c241eb-0a49-4645-8656-93ade2b89e4a', 'volume_size': 1} Apr 10 10:41:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:52 devstack sudo[89085]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d9149882-a372-4d06-91dc-43fafee5f7bb" returned: 0 in 0.415s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:52 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:41:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.164s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:52 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1848395645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a231102-472e-4800-9339-be7729ab404f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6afc05ad9f4cf4bc40bf8a9d808a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:47Z,use_quota=True,user_id='c8aadf967b454cd4a01fdbb3c8af4eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:41:52 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] Creating volume 7a231102-472e-4800-9339-be7729ab404f {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:41:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:52 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:52 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:52 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:52 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:41:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a231102-472e-4800-9339-be7729ab404f 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:52 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff8da6e4-9200-446b-b5c1-01fd30fb0584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9149882-a372-4d06-91dc-43fafee5f7bb', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:52 devstack sudo[89088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a231102-472e-4800-9339-be7729ab404f 1073741824 Apr 10 10:41:52 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:52 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (334e42cd-fda9-494b-8374-7fadc1cc6a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:52 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] Volume volume-d9149882-a372-4d06-91dc-43fafee5f7bb (d9149882-a372-4d06-91dc-43fafee5f7bb): created successfully Apr 10 10:41:52 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (334e42cd-fda9-494b-8374-7fadc1cc6a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:52 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] Flow 'volume_create_manager' (303f6be6-1a7b-4289-a04b-560bc79907b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:52 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-7123302c-0606-45d9-8d0d-d1ea119da952 tempest-CreateVolumesFromImageTest-1560385012 None] Created volume successfully. Apr 10 10:41:52 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a231102-472e-4800-9339-be7729ab404f 1073741824" returned: 0 in 0.472s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a231102-472e-4800-9339-be7729ab404f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:52 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a231102-472e-4800-9339-be7729ab404f Apr 10 10:41:52 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:53 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a231102-472e-4800-9339-be7729ab404f" returned: 0 in 0.421s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:53 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:41:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.902s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:53 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-876983287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65cb2aeb-e317-459d-bfb1-3bd1c062b35a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6afc05ad9f4cf4bc40bf8a9d808a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:47Z,use_quota=True,user_id='c8aadf967b454cd4a01fdbb3c8af4eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:41:53 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] Creating volume 65cb2aeb-e317-459d-bfb1-3bd1c062b35a {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:41:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:53 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:53 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:53 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:53 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:41:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-65cb2aeb-e317-459d-bfb1-3bd1c062b35a 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:53 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c71b5e3-d2d2-4d9a-8ea4-80bfd546f701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a231102-472e-4800-9339-be7729ab404f', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:53 devstack sudo[89096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-65cb2aeb-e317-459d-bfb1-3bd1c062b35a 1073741824 Apr 10 10:41:53 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc281af0-3d90-428d-8657-fbb75e915b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:53 devstack sudo[89096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:53 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] Volume volume-7a231102-472e-4800-9339-be7729ab404f (7a231102-472e-4800-9339-be7729ab404f): created successfully Apr 10 10:41:53 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc281af0-3d90-428d-8657-fbb75e915b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:53 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] Flow 'volume_create_manager' (ce9d90e1-e3d1-4f25-aee7-d1070a7dd4b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:53 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-5cd54407-85d8-4edc-b30b-a65ab4602e8e tempest-CreateVolumesFromImageTest-1560385012 None] Created volume successfully. Apr 10 10:41:53 devstack sudo[89096]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-65cb2aeb-e317-459d-bfb1-3bd1c062b35a 1073741824" returned: 0 in 0.461s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-65cb2aeb-e317-459d-bfb1-3bd1c062b35a {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:53 devstack sudo[89101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-65cb2aeb-e317-459d-bfb1-3bd1c062b35a Apr 10 10:41:53 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:53 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-65cb2aeb-e317-459d-bfb1-3bd1c062b35a" returned: 0 in 0.408s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:53 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:41:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-4f69dabb-f832-4737-9efe-90f22ee35a48 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.484s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:53 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce22821-0505-4286-aecc-a8f6deb54110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65cb2aeb-e317-459d-bfb1-3bd1c062b35a', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:53 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d16a87-4eb4-4ade-bbd3-b2caca71226e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:53 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-4f69dabb-f832-4737-9efe-90f22ee35a48 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Creating offline snapshot 0bea8ae5-0e8d-407c-9a3a-f75d8639a178 of volume e057fb64-b0ff-4cb9-9b69-e40140ca4a79 {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:41:54 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] Volume volume-65cb2aeb-e317-459d-bfb1-3bd1c062b35a (65cb2aeb-e317-459d-bfb1-3bd1c062b35a): created successfully Apr 10 10:41:54 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d16a87-4eb4-4ade-bbd3-b2caca71226e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:54 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] Flow 'volume_create_manager' (99077e43-a3b2-4633-af48-8b4e5f394926) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:54 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df82670-5314-4fe4-871f-19951cbce180]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4f69dabb-f832-4737-9efe-90f22ee35a48 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:54 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-46876487-7193-4de0-9f65-d2866e2eea3a tempest-CreateVolumesFromImageTest-1560385012 None] Created volume successfully. Apr 10 10:41:54 devstack sudo[89104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79 Apr 10 10:41:54 devstack sudo[89104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:54 devstack sudo[89104]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4f69dabb-f832-4737-9efe-90f22ee35a48 tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79" returned: 0 in 0.454s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4f69dabb-f832-4737-9efe-90f22ee35a48 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79.0bea8ae5-0e8d-407c-9a3a-f75d8639a178 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:54 devstack sudo[89109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79.0bea8ae5-0e8d-407c-9a3a-f75d8639a178 1G Apr 10 10:41:54 devstack sudo[89109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:54 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b5396c9c-5601-4c21-9648-49d772b2a2c0 tempest-CreateVolumesFromImageTest-1560385012 None] Acquiring lock "cinder-65cb2aeb-e317-459d-bfb1-3bd1c062b35a-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:54 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b5396c9c-5601-4c21-9648-49d772b2a2c0 tempest-CreateVolumesFromImageTest-1560385012 None] Lock "cinder-65cb2aeb-e317-459d-bfb1-3bd1c062b35a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:54 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b5396c9c-5601-4c21-9648-49d772b2a2c0 tempest-CreateVolumesFromImageTest-1560385012 None] Acquiring lock "cinder-quobyte-65cb2aeb-e317-459d-bfb1-3bd1c062b35a" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:54 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b5396c9c-5601-4c21-9648-49d772b2a2c0 tempest-CreateVolumesFromImageTest-1560385012 None] Lock "cinder-quobyte-65cb2aeb-e317-459d-bfb1-3bd1c062b35a" acquired by "delete_volume" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:54 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bc75ee-10fa-4f39-b0ba-4b32d9ea1a96]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:54 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b5396c9c-5601-4c21-9648-49d772b2a2c0 tempest-CreateVolumesFromImageTest-1560385012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-65cb2aeb-e317-459d-bfb1-3bd1c062b35a {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:54 devstack sudo[89111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-65cb2aeb-e317-459d-bfb1-3bd1c062b35a Apr 10 10:41:54 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:55 devstack sudo[89109]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4f69dabb-f832-4737-9efe-90f22ee35a48 tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79.0bea8ae5-0e8d-407c-9a3a-f75d8639a178 1G" returned: 0 in 0.553s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4f69dabb-f832-4737-9efe-90f22ee35a48 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79.0bea8ae5-0e8d-407c-9a3a-f75d8639a178 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:55 devstack sudo[89116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79.0bea8ae5-0e8d-407c-9a3a-f75d8639a178 Apr 10 10:41:55 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:55 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b5396c9c-5601-4c21-9648-49d772b2a2c0 tempest-CreateVolumesFromImageTest-1560385012 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-65cb2aeb-e317-459d-bfb1-3bd1c062b35a" returned: 0 in 0.516s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b5396c9c-5601-4c21-9648-49d772b2a2c0 tempest-CreateVolumesFromImageTest-1560385012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-65cb2aeb-e317-459d-bfb1-3bd1c062b35a {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:55 devstack sudo[89121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-65cb2aeb-e317-459d-bfb1-3bd1c062b35a Apr 10 10:41:55 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:55 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4f69dabb-f832-4737-9efe-90f22ee35a48 tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79.0bea8ae5-0e8d-407c-9a3a-f75d8639a178" returned: 0 in 0.416s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:55 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-4f69dabb-f832-4737-9efe-90f22ee35a48 tempest-CreateVolumesFromSnapshotTest-1988960030 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79.0bea8ae5-0e8d-407c-9a3a-f75d8639a178 is being set with open permissions: ugo+rw Apr 10 10:41:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4f69dabb-f832-4737-9efe-90f22ee35a48 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79.0bea8ae5-0e8d-407c-9a3a-f75d8639a178 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:55 devstack sudo[89126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79.0bea8ae5-0e8d-407c-9a3a-f75d8639a178 Apr 10 10:41:55 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:55 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b5396c9c-5601-4c21-9648-49d772b2a2c0 tempest-CreateVolumesFromImageTest-1560385012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-65cb2aeb-e317-459d-bfb1-3bd1c062b35a" returned: 0 in 0.429s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:55 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b5396c9c-5601-4c21-9648-49d772b2a2c0 tempest-CreateVolumesFromImageTest-1560385012 None] Lock "cinder-quobyte-65cb2aeb-e317-459d-bfb1-3bd1c062b35a" released by "delete_volume" :: held 0.969s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:55 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-b5396c9c-5601-4c21-9648-49d772b2a2c0 tempest-CreateVolumesFromImageTest-1560385012 None] Created reservations ['bc34950b-7a26-4628-b395-921001db87b3', '65f4c4af-648e-4009-98ba-fc28ed370fa1', '4576f53b-f865-4a63-b52c-5a3316307125', '523d79fc-0983-47d9-bfef-06c5b6b9e386'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b5396c9c-5601-4c21-9648-49d772b2a2c0 tempest-CreateVolumesFromImageTest-1560385012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b5396c9c-5601-4c21-9648-49d772b2a2c0 tempest-CreateVolumesFromImageTest-1560385012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:55 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b5396c9c-5601-4c21-9648-49d772b2a2c0 tempest-CreateVolumesFromImageTest-1560385012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:55 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b5396c9c-5601-4c21-9648-49d772b2a2c0 tempest-CreateVolumesFromImageTest-1560385012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b5396c9c-5601-4c21-9648-49d772b2a2c0 tempest-CreateVolumesFromImageTest-1560385012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b5396c9c-5601-4c21-9648-49d772b2a2c0 tempest-CreateVolumesFromImageTest-1560385012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:55 devstack sudo[89130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:41:55 devstack sudo[89130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:55 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4f69dabb-f832-4737-9efe-90f22ee35a48 tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79.0bea8ae5-0e8d-407c-9a3a-f75d8639a178" returned: 0 in 0.433s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:55 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4f69dabb-f832-4737-9efe-90f22ee35a48 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:55 devstack sudo[89132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79.info Apr 10 10:41:55 devstack sudo[89132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:56 devstack sudo[89130]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b5396c9c-5601-4c21-9648-49d772b2a2c0 tempest-CreateVolumesFromImageTest-1560385012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.431s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:56 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-b5396c9c-5601-4c21-9648-49d772b2a2c0 tempest-CreateVolumesFromImageTest-1560385012 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:56 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-b5396c9c-5601-4c21-9648-49d772b2a2c0 tempest-CreateVolumesFromImageTest-1560385012 None] Deleted volume successfully. Apr 10 10:41:56 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b5396c9c-5601-4c21-9648-49d772b2a2c0 tempest-CreateVolumesFromImageTest-1560385012 None] Lock "cinder-65cb2aeb-e317-459d-bfb1-3bd1c062b35a-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:56 devstack sudo[89132]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4f69dabb-f832-4737-9efe-90f22ee35a48 tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79.info" returned: 0 in 0.431s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:56 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-4f69dabb-f832-4737-9efe-90f22ee35a48 tempest-CreateVolumesFromSnapshotTest-1988960030 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79.info is being set with open permissions: ugo+rw Apr 10 10:41:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4f69dabb-f832-4737-9efe-90f22ee35a48 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:56 devstack sudo[89136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79.info Apr 10 10:41:56 devstack sudo[89136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:56 devstack sudo[89136]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4f69dabb-f832-4737-9efe-90f22ee35a48 tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79.info" returned: 0 in 0.404s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-4f69dabb-f832-4737-9efe-90f22ee35a48 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.763s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d57b01d2-8b0d-422b-89e8-dc42018e1290 tempest-VolumeDependencyTests-421615573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.114s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:56 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-4f69dabb-f832-4737-9efe-90f22ee35a48 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Create snapshot completed successfully Apr 10 10:41:56 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-d57b01d2-8b0d-422b-89e8-dc42018e1290 tempest-VolumeDependencyTests-421615573 None] Creating offline snapshot ee825c98-c218-45e8-9acc-42c80c3c32be of volume 7a78b455-89df-4117-aaa8-5c2901d5144d {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:41:56 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b209b80-4a9e-4c94-9b8e-2b27d12b3814]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d57b01d2-8b0d-422b-89e8-dc42018e1290 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:56 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-4213162e-8805-4b62-b972-41ceb5db120a tempest-CreateVolumesFromImageTest-1560385012 None] Acquiring lock "cinder-7a231102-472e-4800-9339-be7729ab404f-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:56 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-4213162e-8805-4b62-b972-41ceb5db120a tempest-CreateVolumesFromImageTest-1560385012 None] Lock "cinder-7a231102-472e-4800-9339-be7729ab404f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:56 devstack sudo[89139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d Apr 10 10:41:56 devstack sudo[89139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:56 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-4213162e-8805-4b62-b972-41ceb5db120a tempest-CreateVolumesFromImageTest-1560385012 None] Acquiring lock "cinder-quobyte-7a231102-472e-4800-9339-be7729ab404f" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:56 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-4213162e-8805-4b62-b972-41ceb5db120a tempest-CreateVolumesFromImageTest-1560385012 None] Lock "cinder-quobyte-7a231102-472e-4800-9339-be7729ab404f" acquired by "delete_volume" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:56 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad3bc2f-2595-4fb0-af0a-17134f82df11]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:56 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4213162e-8805-4b62-b972-41ceb5db120a tempest-CreateVolumesFromImageTest-1560385012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a231102-472e-4800-9339-be7729ab404f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:57 devstack sudo[89141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a231102-472e-4800-9339-be7729ab404f Apr 10 10:41:57 devstack sudo[89141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:57 devstack sudo[89139]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d57b01d2-8b0d-422b-89e8-dc42018e1290 tempest-VolumeDependencyTests-421615573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d" returned: 0 in 0.574s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d57b01d2-8b0d-422b-89e8-dc42018e1290 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d.ee825c98-c218-45e8-9acc-42c80c3c32be 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:57 devstack sudo[89147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d.ee825c98-c218-45e8-9acc-42c80c3c32be 1G Apr 10 10:41:57 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:57 devstack sudo[89141]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4213162e-8805-4b62-b972-41ceb5db120a tempest-CreateVolumesFromImageTest-1560385012 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a231102-472e-4800-9339-be7729ab404f" returned: 0 in 0.545s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4213162e-8805-4b62-b972-41ceb5db120a tempest-CreateVolumesFromImageTest-1560385012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a231102-472e-4800-9339-be7729ab404f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:57 devstack sudo[89152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a231102-472e-4800-9339-be7729ab404f Apr 10 10:41:57 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:57 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d57b01d2-8b0d-422b-89e8-dc42018e1290 tempest-VolumeDependencyTests-421615573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d.ee825c98-c218-45e8-9acc-42c80c3c32be 1G" returned: 0 in 0.529s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d57b01d2-8b0d-422b-89e8-dc42018e1290 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a78b455-89df-4117-aaa8-5c2901d5144d -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d.ee825c98-c218-45e8-9acc-42c80c3c32be {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:57 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:57 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4213162e-8805-4b62-b972-41ceb5db120a tempest-CreateVolumesFromImageTest-1560385012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a231102-472e-4800-9339-be7729ab404f" returned: 0 in 0.431s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:57 devstack sudo[89158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a78b455-89df-4117-aaa8-5c2901d5144d -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d.ee825c98-c218-45e8-9acc-42c80c3c32be Apr 10 10:41:57 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:57 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-4213162e-8805-4b62-b972-41ceb5db120a tempest-CreateVolumesFromImageTest-1560385012 None] Lock "cinder-quobyte-7a231102-472e-4800-9339-be7729ab404f" released by "delete_volume" :: held 1.007s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:57 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-4213162e-8805-4b62-b972-41ceb5db120a tempest-CreateVolumesFromImageTest-1560385012 None] Created reservations ['f33c707e-08e2-44bc-b84d-92f2e573c38e', '5f99b991-8c0e-4c32-9ac0-8fbefdf4e6af', '1d100acf-60d6-4dff-870b-21e71a740adc', 'dcb95500-1808-4e14-8ab7-75a110e296c3'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-4213162e-8805-4b62-b972-41ceb5db120a tempest-CreateVolumesFromImageTest-1560385012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-4213162e-8805-4b62-b972-41ceb5db120a tempest-CreateVolumesFromImageTest-1560385012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-4213162e-8805-4b62-b972-41ceb5db120a tempest-CreateVolumesFromImageTest-1560385012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-4213162e-8805-4b62-b972-41ceb5db120a tempest-CreateVolumesFromImageTest-1560385012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-4213162e-8805-4b62-b972-41ceb5db120a tempest-CreateVolumesFromImageTest-1560385012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4213162e-8805-4b62-b972-41ceb5db120a tempest-CreateVolumesFromImageTest-1560385012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:58 devstack sudo[89160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:41:58 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Flow 'volume_create_manager' (69ba36eb-e25b-4ac3-9758-a26842bdb730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d93c6c-bb47-4687-b7f4-29cd1afc66df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d93c6c-bb47-4687-b7f4-29cd1afc66df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1818032280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a36949-17e6-4fe4-a744-f385e947687b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f04d6ace1945009b5b39b99bd0f2b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:58Z,use_quota=True,user_id='6d41f99b92eb4835b48e237cd6187482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8989c6ea-e20d-4183-aec8-1542ca4782f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8989c6ea-e20d-4183-aec8-1542ca4782f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe50adaa-b481-496f-bd6a-12ba058b40e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe50adaa-b481-496f-bd6a-12ba058b40e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7a36949-17e6-4fe4-a744-f385e947687b', 'volume_name': 'volume-c7a36949-17e6-4fe4-a744-f385e947687b', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab1cadc-246a-4b7a-84ff-d142bf6b9da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab1cadc-246a-4b7a-84ff-d142bf6b9da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5e511ca-7c99-4746-8847-58f9a3d26f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:58 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Volume c7a36949-17e6-4fe4-a744-f385e947687b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7a36949-17e6-4fe4-a744-f385e947687b', 'volume_size': 1} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Flow 'volume_create_manager' (39903742-5474-4c78-b92f-fdd4d0b1d39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d683e7-3158-4feb-b570-17115c3a788d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d683e7-3158-4feb-b570-17115c3a788d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-347216124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1500b797-860b-4f8c-969f-812aa0252e7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f04d6ace1945009b5b39b99bd0f2b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:58Z,use_quota=True,user_id='6d41f99b92eb4835b48e237cd6187482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5073d784-4f66-4941-b0df-1c062cb91856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5073d784-4f66-4941-b0df-1c062cb91856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d3adaf4-efb7-4ebc-b7fe-e7b4d64db27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d3adaf4-efb7-4ebc-b7fe-e7b4d64db27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1500b797-860b-4f8c-969f-812aa0252e7f', 'volume_name': 'volume-1500b797-860b-4f8c-969f-812aa0252e7f', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2ef8ee-71d8-4fb2-8f59-a26535312437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2ef8ee-71d8-4fb2-8f59-a26535312437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0bc9060-efd9-4230-8dca-25a2f4775ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:58 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Volume 1500b797-860b-4f8c-969f-812aa0252e7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1500b797-860b-4f8c-969f-812aa0252e7f', 'volume_size': 1} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:58 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Flow 'volume_create_manager' (ff74865e-0cfa-4ea1-8a9c-c329ff3a9bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c48d6e4-bb8e-4596-8d10-c23bce1925a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d57b01d2-8b0d-422b-89e8-dc42018e1290 tempest-VolumeDependencyTests-421615573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a78b455-89df-4117-aaa8-5c2901d5144d -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d.ee825c98-c218-45e8-9acc-42c80c3c32be" returned: 0 in 0.775s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:58 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-d57b01d2-8b0d-422b-89e8-dc42018e1290 tempest-VolumeDependencyTests-421615573 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d.ee825c98-c218-45e8-9acc-42c80c3c32be is being set with open permissions: ugo+rw Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d57b01d2-8b0d-422b-89e8-dc42018e1290 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d.ee825c98-c218-45e8-9acc-42c80c3c32be {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:58 devstack sudo[89200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d.ee825c98-c218-45e8-9acc-42c80c3c32be Apr 10 10:41:58 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c48d6e4-bb8e-4596-8d10-c23bce1925a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1208894129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ccedc10-d9ec-4bb2-896f-686ac6e5b447,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f04d6ace1945009b5b39b99bd0f2b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:59Z,use_quota=True,user_id='6d41f99b92eb4835b48e237cd6187482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a5e03a-0480-4861-944a-8323573a3d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a5e03a-0480-4861-944a-8323573a3d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd7dd77-14d0-42b8-bba6-3e2504696b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd7dd77-14d0-42b8-bba6-3e2504696b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ccedc10-d9ec-4bb2-896f-686ac6e5b447', 'volume_name': 'volume-7ccedc10-d9ec-4bb2-896f-686ac6e5b447', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d80ace5e-0626-40e1-b1aa-6be537a3ed48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d80ace5e-0626-40e1-b1aa-6be537a3ed48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d57acda-7307-4ea0-99bf-6f2caffacd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:58 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Volume 7ccedc10-d9ec-4bb2-896f-686ac6e5b447: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ccedc10-d9ec-4bb2-896f-686ac6e5b447', 'volume_size': 1} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:58 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4213162e-8805-4b62-b972-41ceb5db120a tempest-CreateVolumesFromImageTest-1560385012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.667s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-4213162e-8805-4b62-b972-41ceb5db120a tempest-CreateVolumesFromImageTest-1560385012 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:58 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-4213162e-8805-4b62-b972-41ceb5db120a tempest-CreateVolumesFromImageTest-1560385012 None] Deleted volume successfully. Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-4213162e-8805-4b62-b972-41ceb5db120a tempest-CreateVolumesFromImageTest-1560385012 None] Lock "cinder-7a231102-472e-4800-9339-be7729ab404f-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Flow 'volume_create_manager' (9b2725dc-aaa5-4960-bd3b-a77fc503336f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c7a1eb5-0aad-4c84-9f10-f0fad02c6edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c7a1eb5-0aad-4c84-9f10-f0fad02c6edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1406508598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec0ee6b5-f572-4d2f-accc-f3feb9bd9aeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f04d6ace1945009b5b39b99bd0f2b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:59Z,use_quota=True,user_id='6d41f99b92eb4835b48e237cd6187482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7858258-216c-4324-94c7-6fa9167d8bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7858258-216c-4324-94c7-6fa9167d8bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e2c7cd-6f87-481f-9a4b-79429e1a341b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e2c7cd-6f87-481f-9a4b-79429e1a341b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec0ee6b5-f572-4d2f-accc-f3feb9bd9aeb', 'volume_name': 'volume-ec0ee6b5-f572-4d2f-accc-f3feb9bd9aeb', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c0c880a-6e9a-422a-932b-5f9ba93f756a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c0c880a-6e9a-422a-932b-5f9ba93f756a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (980c667f-00f2-4d1c-9b07-2403478418ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:58 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Volume ec0ee6b5-f572-4d2f-accc-f3feb9bd9aeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec0ee6b5-f572-4d2f-accc-f3feb9bd9aeb', 'volume_size': 1} Apr 10 10:41:58 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:59 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-5c11f30a-aa3a-4083-94e0-14ba636c8efa tempest-CreateVolumesFromImageTest-1560385012 None] Acquiring lock "cinder-d9149882-a372-4d06-91dc-43fafee5f7bb-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:59 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Flow 'volume_create_manager' (2dbbb4b5-8c7e-413e-8af7-64363a825887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de01bfbb-9ff1-46eb-8f33-7905f2d2a6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:59 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-5c11f30a-aa3a-4083-94e0-14ba636c8efa tempest-CreateVolumesFromImageTest-1560385012 None] Lock "cinder-d9149882-a372-4d06-91dc-43fafee5f7bb-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:59 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de01bfbb-9ff1-46eb-8f33-7905f2d2a6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-915935904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7698a1c7-084c-48c8-b690-1e7c95ac8f65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f04d6ace1945009b5b39b99bd0f2b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:59Z,use_quota=True,user_id='6d41f99b92eb4835b48e237cd6187482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1675ea6-ba01-4cad-85ba-f457667977ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1675ea6-ba01-4cad-85ba-f457667977ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91461277-fb61-47ed-a7c0-612f165ccc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91461277-fb61-47ed-a7c0-612f165ccc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7698a1c7-084c-48c8-b690-1e7c95ac8f65', 'volume_name': 'volume-7698a1c7-084c-48c8-b690-1e7c95ac8f65', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d1b249e-239e-484a-82fc-4e4fa29450fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d1b249e-239e-484a-82fc-4e4fa29450fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:59 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28abf36-4db2-43cd-9947-1e5deec2f729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:59 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Volume 7698a1c7-084c-48c8-b690-1e7c95ac8f65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7698a1c7-084c-48c8-b690-1e7c95ac8f65', 'volume_size': 1} Apr 10 10:41:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d57b01d2-8b0d-422b-89e8-dc42018e1290 tempest-VolumeDependencyTests-421615573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d.ee825c98-c218-45e8-9acc-42c80c3c32be" returned: 0 in 0.521s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:59 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-5c11f30a-aa3a-4083-94e0-14ba636c8efa tempest-CreateVolumesFromImageTest-1560385012 None] Acquiring lock "cinder-quobyte-d9149882-a372-4d06-91dc-43fafee5f7bb" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d57b01d2-8b0d-422b-89e8-dc42018e1290 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:59 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-5c11f30a-aa3a-4083-94e0-14ba636c8efa tempest-CreateVolumesFromImageTest-1560385012 None] Lock "cinder-quobyte-d9149882-a372-4d06-91dc-43fafee5f7bb" acquired by "delete_volume" :: waited 0.025s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:59 devstack sudo[89203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d.info Apr 10 10:41:59 devstack sudo[89203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:59 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48c1477-da06-47da-bf1f-1a79cfc1ab8f]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5c11f30a-aa3a-4083-94e0-14ba636c8efa tempest-CreateVolumesFromImageTest-1560385012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d9149882-a372-4d06-91dc-43fafee5f7bb {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:59 devstack sudo[89205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d9149882-a372-4d06-91dc-43fafee5f7bb Apr 10 10:41:59 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:59 devstack sudo[89203]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d57b01d2-8b0d-422b-89e8-dc42018e1290 tempest-VolumeDependencyTests-421615573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d.info" returned: 0 in 0.404s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:59 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-d57b01d2-8b0d-422b-89e8-dc42018e1290 tempest-VolumeDependencyTests-421615573 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d.info is being set with open permissions: ugo+rw Apr 10 10:41:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d57b01d2-8b0d-422b-89e8-dc42018e1290 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:59 devstack sudo[89208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d.info Apr 10 10:41:59 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:59 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5c11f30a-aa3a-4083-94e0-14ba636c8efa tempest-CreateVolumesFromImageTest-1560385012 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d9149882-a372-4d06-91dc-43fafee5f7bb" returned: 0 in 0.529s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:59 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5c11f30a-aa3a-4083-94e0-14ba636c8efa tempest-CreateVolumesFromImageTest-1560385012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d9149882-a372-4d06-91dc-43fafee5f7bb {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:59 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d9149882-a372-4d06-91dc-43fafee5f7bb Apr 10 10:41:59 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:00 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-d57b01d2-8b0d-422b-89e8-dc42018e1290 tempest-VolumeDependencyTests-421615573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d.info" returned: 0 in 0.407s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-d57b01d2-8b0d-422b-89e8-dc42018e1290 tempest-VolumeDependencyTests-421615573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.291s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.097s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:00 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-60214453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e05ea640-c9b4-4c50-95c7-a3c152f59894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f983b221144642965612251a64f3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:51Z,use_quota=True,user_id='b8374366ca5245d7b0e245c9ed22a313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:42:00 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Creating volume e05ea640-c9b4-4c50-95c7-a3c152f59894 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:42:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:00 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:00 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:00 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:42:00 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:42:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e05ea640-c9b4-4c50-95c7-a3c152f59894 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:00 devstack sudo[89217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e05ea640-c9b4-4c50-95c7-a3c152f59894 1073741824 Apr 10 10:42:00 devstack sudo[89217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:00 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-d57b01d2-8b0d-422b-89e8-dc42018e1290 tempest-VolumeDependencyTests-421615573 None] Create snapshot completed successfully Apr 10 10:42:00 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5c11f30a-aa3a-4083-94e0-14ba636c8efa tempest-CreateVolumesFromImageTest-1560385012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d9149882-a372-4d06-91dc-43fafee5f7bb" returned: 0 in 0.449s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:00 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-5c11f30a-aa3a-4083-94e0-14ba636c8efa tempest-CreateVolumesFromImageTest-1560385012 None] Lock "cinder-quobyte-d9149882-a372-4d06-91dc-43fafee5f7bb" released by "delete_volume" :: held 1.004s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:00 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-5c11f30a-aa3a-4083-94e0-14ba636c8efa tempest-CreateVolumesFromImageTest-1560385012 None] Created reservations ['10b3fb55-8dbd-476f-93b2-89049bc597de', 'c09c7da2-a931-4ef8-a4e4-cb8a0d566e5a', 'fdf28164-6b43-43ca-bf69-c8f6839d8549', '1f69aafd-bf61-45cd-8e0e-a8b681a06c2b'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5c11f30a-aa3a-4083-94e0-14ba636c8efa tempest-CreateVolumesFromImageTest-1560385012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5c11f30a-aa3a-4083-94e0-14ba636c8efa tempest-CreateVolumesFromImageTest-1560385012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:00 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5c11f30a-aa3a-4083-94e0-14ba636c8efa tempest-CreateVolumesFromImageTest-1560385012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:00 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-5c11f30a-aa3a-4083-94e0-14ba636c8efa tempest-CreateVolumesFromImageTest-1560385012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-5c11f30a-aa3a-4083-94e0-14ba636c8efa tempest-CreateVolumesFromImageTest-1560385012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5c11f30a-aa3a-4083-94e0-14ba636c8efa tempest-CreateVolumesFromImageTest-1560385012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:00 devstack sudo[89220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:42:00 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:00 devstack sudo[89217]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e05ea640-c9b4-4c50-95c7-a3c152f59894 1073741824" returned: 0 in 0.508s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e05ea640-c9b4-4c50-95c7-a3c152f59894 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:00 devstack sudo[89225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e05ea640-c9b4-4c50-95c7-a3c152f59894 Apr 10 10:42:00 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:00 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:00 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-5c11f30a-aa3a-4083-94e0-14ba636c8efa tempest-CreateVolumesFromImageTest-1560385012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.423s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:00 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-5c11f30a-aa3a-4083-94e0-14ba636c8efa tempest-CreateVolumesFromImageTest-1560385012 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:00 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-5c11f30a-aa3a-4083-94e0-14ba636c8efa tempest-CreateVolumesFromImageTest-1560385012 None] Deleted volume successfully. Apr 10 10:42:00 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-5c11f30a-aa3a-4083-94e0-14ba636c8efa tempest-CreateVolumesFromImageTest-1560385012 None] Lock "cinder-d9149882-a372-4d06-91dc-43fafee5f7bb-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:01 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e05ea640-c9b4-4c50-95c7-a3c152f59894" returned: 0 in 0.428s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.810s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1489872481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acbaed7c-223c-47dd-82bc-5c2f84183796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f983b221144642965612251a64f3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:51Z,use_quota=True,user_id='b8374366ca5245d7b0e245c9ed22a313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Creating volume acbaed7c-223c-47dd-82bc-5c2f84183796 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:42:01 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-acbaed7c-223c-47dd-82bc-5c2f84183796 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e08eb2e1-058d-489d-aa3c-11de57268e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e05ea640-c9b4-4c50-95c7-a3c152f59894', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3777b278-251a-4cc3-a861-4178d59892ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:01 devstack sudo[89229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-acbaed7c-223c-47dd-82bc-5c2f84183796 1073741824 Apr 10 10:42:01 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:01 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Volume volume-e05ea640-c9b4-4c50-95c7-a3c152f59894 (e05ea640-c9b4-4c50-95c7-a3c152f59894): created successfully Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3777b278-251a-4cc3-a861-4178d59892ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Flow 'volume_create_manager' (557bcd7d-2fa3-4f61-a1b1-673eaaf07bdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:01 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-f4eb41cb-4d86-4126-a13f-788eb8b1d1c1 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Created volume successfully. Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Flow 'volume_create_manager' (9d1f519c-fc64-4110-bc3c-1fc16cb9e9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30399c59-d3f3-4e6e-9793-570355990501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30399c59-d3f3-4e6e-9793-570355990501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1270029504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd3e9b6-0ff8-4a61-82bd-4422e675304c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f270f4de02f476fac3ad759b5c0e75f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ee825c98-c218-45e8-9acc-42c80c3c32be,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:42:01Z,use_quota=True,user_id='63fbc81099794683a95d08b5b17d020d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdfc0fff-f146-49f6-ad6b-5dcd8c55c260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdfc0fff-f146-49f6-ad6b-5dcd8c55c260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46235e0d-031e-459a-b994-37b0c52e3e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46235e0d-031e-459a-b994-37b0c52e3e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'afd3e9b6-0ff8-4a61-82bd-4422e675304c', 'volume_name': 'volume-afd3e9b6-0ff8-4a61-82bd-4422e675304c', 'volume_size': 1, 'snapshot_id': 'ee825c98-c218-45e8-9acc-42c80c3c32be'}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18527a1a-06ab-4514-bead-e96d35129355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18527a1a-06ab-4514-bead-e96d35129355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94f0ca5-92bb-4eb5-97d9-bf3aece0ae72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:01 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Volume afd3e9b6-0ff8-4a61-82bd-4422e675304c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-afd3e9b6-0ff8-4a61-82bd-4422e675304c', 'volume_size': 1, 'snapshot_id': 'ee825c98-c218-45e8-9acc-42c80c3c32be'} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e4cbc7b7-cb70-4815-8418-e98f1c0c2d7f tempest-CreateVolumesFromImageTest-1560385012 None] Acquiring lock "cinder-05b2f6c1-981b-4aa8-9ccd-2b8cdc91aaf2-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e4cbc7b7-cb70-4815-8418-e98f1c0c2d7f tempest-CreateVolumesFromImageTest-1560385012 None] Lock "cinder-05b2f6c1-981b-4aa8-9ccd-2b8cdc91aaf2-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e4cbc7b7-cb70-4815-8418-e98f1c0c2d7f tempest-CreateVolumesFromImageTest-1560385012 None] Acquiring lock "cinder-quobyte-05b2f6c1-981b-4aa8-9ccd-2b8cdc91aaf2" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e4cbc7b7-cb70-4815-8418-e98f1c0c2d7f tempest-CreateVolumesFromImageTest-1560385012 None] Lock "cinder-quobyte-05b2f6c1-981b-4aa8-9ccd-2b8cdc91aaf2" acquired by "delete_volume" :: waited 0.007s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce501882-28c3-4172-8a26-00773c32651c]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e4cbc7b7-cb70-4815-8418-e98f1c0c2d7f tempest-CreateVolumesFromImageTest-1560385012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-05b2f6c1-981b-4aa8-9ccd-2b8cdc91aaf2 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:01 devstack sudo[89231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-05b2f6c1-981b-4aa8-9ccd-2b8cdc91aaf2 Apr 10 10:42:01 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:01 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-acbaed7c-223c-47dd-82bc-5c2f84183796 1073741824" returned: 0 in 0.552s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-acbaed7c-223c-47dd-82bc-5c2f84183796 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:01 devstack sudo[89236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-acbaed7c-223c-47dd-82bc-5c2f84183796 Apr 10 10:42:01 devstack sudo[89236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:01 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e4cbc7b7-cb70-4815-8418-e98f1c0c2d7f tempest-CreateVolumesFromImageTest-1560385012 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-05b2f6c1-981b-4aa8-9ccd-2b8cdc91aaf2" returned: 0 in 0.513s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:01 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e4cbc7b7-cb70-4815-8418-e98f1c0c2d7f tempest-CreateVolumesFromImageTest-1560385012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-05b2f6c1-981b-4aa8-9ccd-2b8cdc91aaf2 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:01 devstack sudo[89241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-05b2f6c1-981b-4aa8-9ccd-2b8cdc91aaf2 Apr 10 10:42:01 devstack sudo[89241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:02 devstack sudo[89236]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-acbaed7c-223c-47dd-82bc-5c2f84183796" returned: 0 in 0.421s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:02 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:42:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.674s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:02 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1120498029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d463964b-0c97-4bbc-bafe-91da4f094cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f983b221144642965612251a64f3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:51Z,use_quota=True,user_id='b8374366ca5245d7b0e245c9ed22a313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:42:02 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Creating volume d463964b-0c97-4bbc-bafe-91da4f094cb5 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:42:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:02 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:02 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:02 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:42:02 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:42:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d463964b-0c97-4bbc-bafe-91da4f094cb5 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:02 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc601e2-387f-433f-a35b-ac4b4f737175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acbaed7c-223c-47dd-82bc-5c2f84183796', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:02 devstack sudo[89244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d463964b-0c97-4bbc-bafe-91da4f094cb5 1073741824 Apr 10 10:42:02 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:02 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e39c73f-d445-465b-8182-c2487481bd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:02 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Volume volume-acbaed7c-223c-47dd-82bc-5c2f84183796 (acbaed7c-223c-47dd-82bc-5c2f84183796): created successfully Apr 10 10:42:02 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e39c73f-d445-465b-8182-c2487481bd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:02 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Flow 'volume_create_manager' (e591b39e-05e7-46e5-b9f9-c137c9cbb8f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:02 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-b01636b0-e098-47d3-a624-1284b577e759 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Created volume successfully. Apr 10 10:42:02 devstack sudo[89241]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e4cbc7b7-cb70-4815-8418-e98f1c0c2d7f tempest-CreateVolumesFromImageTest-1560385012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-05b2f6c1-981b-4aa8-9ccd-2b8cdc91aaf2" returned: 0 in 0.491s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:02 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e4cbc7b7-cb70-4815-8418-e98f1c0c2d7f tempest-CreateVolumesFromImageTest-1560385012 None] Lock "cinder-quobyte-05b2f6c1-981b-4aa8-9ccd-2b8cdc91aaf2" released by "delete_volume" :: held 1.032s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:02 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-e4cbc7b7-cb70-4815-8418-e98f1c0c2d7f tempest-CreateVolumesFromImageTest-1560385012 None] Created reservations ['b9ea483e-7062-46e7-bb59-b7521a93e1b2', 'c5a7be1f-b220-412f-b8ad-94d30a2d69e4', '6b4932ea-67f5-4ddd-8016-c056cecf0b70', 'ad9e2163-507a-4cd1-a956-d2097161c6fe'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e4cbc7b7-cb70-4815-8418-e98f1c0c2d7f tempest-CreateVolumesFromImageTest-1560385012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e4cbc7b7-cb70-4815-8418-e98f1c0c2d7f tempest-CreateVolumesFromImageTest-1560385012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:02 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e4cbc7b7-cb70-4815-8418-e98f1c0c2d7f tempest-CreateVolumesFromImageTest-1560385012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:02 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-e4cbc7b7-cb70-4815-8418-e98f1c0c2d7f tempest-CreateVolumesFromImageTest-1560385012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-e4cbc7b7-cb70-4815-8418-e98f1c0c2d7f tempest-CreateVolumesFromImageTest-1560385012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e4cbc7b7-cb70-4815-8418-e98f1c0c2d7f tempest-CreateVolumesFromImageTest-1560385012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:02 devstack sudo[89250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:42:02 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:02 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d463964b-0c97-4bbc-bafe-91da4f094cb5 1073741824" returned: 0 in 0.584s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d463964b-0c97-4bbc-bafe-91da4f094cb5 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:02 devstack sudo[89252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d463964b-0c97-4bbc-bafe-91da4f094cb5 Apr 10 10:42:02 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:02 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:02 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-e4cbc7b7-cb70-4815-8418-e98f1c0c2d7f tempest-CreateVolumesFromImageTest-1560385012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.408s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:02 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-e4cbc7b7-cb70-4815-8418-e98f1c0c2d7f tempest-CreateVolumesFromImageTest-1560385012 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:02 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-e4cbc7b7-cb70-4815-8418-e98f1c0c2d7f tempest-CreateVolumesFromImageTest-1560385012 None] Deleted volume successfully. Apr 10 10:42:02 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-e4cbc7b7-cb70-4815-8418-e98f1c0c2d7f tempest-CreateVolumesFromImageTest-1560385012 None] Lock "cinder-05b2f6c1-981b-4aa8-9ccd-2b8cdc91aaf2-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:03 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d463964b-0c97-4bbc-bafe-91da4f094cb5" returned: 0 in 0.403s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:03 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:42:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.447s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:03 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-436567417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ec363f1-6f00-49d7-981d-a74238081e47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f983b221144642965612251a64f3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:51Z,use_quota=True,user_id='b8374366ca5245d7b0e245c9ed22a313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:42:03 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Creating volume 6ec363f1-6f00-49d7-981d-a74238081e47 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:42:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:03 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:03 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:03 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:42:03 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:42:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6ec363f1-6f00-49d7-981d-a74238081e47 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:03 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c1ed560-2040-49ef-a2cb-bfea60f31504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d463964b-0c97-4bbc-bafe-91da4f094cb5', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:03 devstack sudo[89256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6ec363f1-6f00-49d7-981d-a74238081e47 1073741824 Apr 10 10:42:03 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:03 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd709d65-165b-4bab-b51f-bd1210709d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:03 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Volume volume-d463964b-0c97-4bbc-bafe-91da4f094cb5 (d463964b-0c97-4bbc-bafe-91da4f094cb5): created successfully Apr 10 10:42:03 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd709d65-165b-4bab-b51f-bd1210709d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:03 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Flow 'volume_create_manager' (11852313-30f0-47de-a433-9ab8d6ecb39c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:03 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-b1e45029-8eea-48cf-b8e6-2d11f9a4d25f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Created volume successfully. Apr 10 10:42:03 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7b3a267e-b504-4cb4-8be5-2d940777941b tempest-CreateVolumesFromImageTest-1560385012 None] Acquiring lock "cinder-d63115af-eb5d-4759-b619-837e6410d69b-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:03 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7b3a267e-b504-4cb4-8be5-2d940777941b tempest-CreateVolumesFromImageTest-1560385012 None] Lock "cinder-d63115af-eb5d-4759-b619-837e6410d69b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:03 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7b3a267e-b504-4cb4-8be5-2d940777941b tempest-CreateVolumesFromImageTest-1560385012 None] Acquiring lock "cinder-quobyte-d63115af-eb5d-4759-b619-837e6410d69b" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:03 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7b3a267e-b504-4cb4-8be5-2d940777941b tempest-CreateVolumesFromImageTest-1560385012 None] Lock "cinder-quobyte-d63115af-eb5d-4759-b619-837e6410d69b" acquired by "delete_volume" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:03 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7688072-59c8-4739-9021-3868e1026483]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7b3a267e-b504-4cb4-8be5-2d940777941b tempest-CreateVolumesFromImageTest-1560385012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d63115af-eb5d-4759-b619-837e6410d69b {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:03 devstack sudo[89261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d63115af-eb5d-4759-b619-837e6410d69b Apr 10 10:42:03 devstack sudo[89261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:03 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6ec363f1-6f00-49d7-981d-a74238081e47 1073741824" returned: 0 in 0.631s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:03 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6ec363f1-6f00-49d7-981d-a74238081e47 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:03 devstack sudo[89263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6ec363f1-6f00-49d7-981d-a74238081e47 Apr 10 10:42:03 devstack sudo[89263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:04 devstack sudo[89261]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7b3a267e-b504-4cb4-8be5-2d940777941b tempest-CreateVolumesFromImageTest-1560385012 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d63115af-eb5d-4759-b619-837e6410d69b" returned: 0 in 0.469s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7b3a267e-b504-4cb4-8be5-2d940777941b tempest-CreateVolumesFromImageTest-1560385012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d63115af-eb5d-4759-b619-837e6410d69b {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:04 devstack sudo[89268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d63115af-eb5d-4759-b619-837e6410d69b Apr 10 10:42:04 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:04 devstack sudo[89263]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6ec363f1-6f00-49d7-981d-a74238081e47" returned: 0 in 0.425s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:04 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:42:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.318s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:04 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1152730247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c241eb-0a49-4645-8656-93ade2b89e4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f983b221144642965612251a64f3d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:52Z,use_quota=True,user_id='b8374366ca5245d7b0e245c9ed22a313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:42:04 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Creating volume 60c241eb-0a49-4645-8656-93ade2b89e4a {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:42:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:04 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:04 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:04 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:42:04 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:42:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-60c241eb-0a49-4645-8656-93ade2b89e4a 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:04 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a368b12d-8fc2-4dcc-a4c4-b016391307cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ec363f1-6f00-49d7-981d-a74238081e47', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:04 devstack sudo[89271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-60c241eb-0a49-4645-8656-93ade2b89e4a 1073741824 Apr 10 10:42:04 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:04 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ca4e129-a1af-4814-aa7e-5eef827215fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:04 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Volume volume-6ec363f1-6f00-49d7-981d-a74238081e47 (6ec363f1-6f00-49d7-981d-a74238081e47): created successfully Apr 10 10:42:04 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ca4e129-a1af-4814-aa7e-5eef827215fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:04 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Flow 'volume_create_manager' (d9142a84-e4b2-4bcf-9f4a-8b375e0d52a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:04 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-eecb7719-7e45-40b4-832a-f2ea7824d098 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Created volume successfully. Apr 10 10:42:04 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7b3a267e-b504-4cb4-8be5-2d940777941b tempest-CreateVolumesFromImageTest-1560385012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d63115af-eb5d-4759-b619-837e6410d69b" returned: 0 in 0.444s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:04 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7b3a267e-b504-4cb4-8be5-2d940777941b tempest-CreateVolumesFromImageTest-1560385012 None] Lock "cinder-quobyte-d63115af-eb5d-4759-b619-837e6410d69b" released by "delete_volume" :: held 0.937s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:04 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-7b3a267e-b504-4cb4-8be5-2d940777941b tempest-CreateVolumesFromImageTest-1560385012 None] Created reservations ['5beea632-3a1e-46e9-951a-05dff79a3a83', '17751990-238f-44c9-8e7d-bac18c362776', '3fbc107d-1f87-4eab-a673-8e9457470b5a', 'c2a401b7-cdc8-4b6f-b785-f72328150aeb'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7b3a267e-b504-4cb4-8be5-2d940777941b tempest-CreateVolumesFromImageTest-1560385012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7b3a267e-b504-4cb4-8be5-2d940777941b tempest-CreateVolumesFromImageTest-1560385012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:04 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7b3a267e-b504-4cb4-8be5-2d940777941b tempest-CreateVolumesFromImageTest-1560385012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:04 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7b3a267e-b504-4cb4-8be5-2d940777941b tempest-CreateVolumesFromImageTest-1560385012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7b3a267e-b504-4cb4-8be5-2d940777941b tempest-CreateVolumesFromImageTest-1560385012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7b3a267e-b504-4cb4-8be5-2d940777941b tempest-CreateVolumesFromImageTest-1560385012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:04 devstack sudo[89277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:42:04 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:04 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-60c241eb-0a49-4645-8656-93ade2b89e4a 1073741824" returned: 0 in 0.562s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:04 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-60c241eb-0a49-4645-8656-93ade2b89e4a {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:04 devstack sudo[89279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-60c241eb-0a49-4645-8656-93ade2b89e4a Apr 10 10:42:04 devstack sudo[89279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:05 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7b3a267e-b504-4cb4-8be5-2d940777941b tempest-CreateVolumesFromImageTest-1560385012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.538s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:05 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-7b3a267e-b504-4cb4-8be5-2d940777941b tempest-CreateVolumesFromImageTest-1560385012 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:05 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-7b3a267e-b504-4cb4-8be5-2d940777941b tempest-CreateVolumesFromImageTest-1560385012 None] Deleted volume successfully. Apr 10 10:42:05 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7b3a267e-b504-4cb4-8be5-2d940777941b tempest-CreateVolumesFromImageTest-1560385012 None] Lock "cinder-d63115af-eb5d-4759-b619-837e6410d69b-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:05 devstack sudo[89279]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-60c241eb-0a49-4645-8656-93ade2b89e4a" returned: 0 in 0.444s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:05 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:42:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.929s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:05 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1818032280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a36949-17e6-4fe4-a744-f385e947687b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f04d6ace1945009b5b39b99bd0f2b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:58Z,use_quota=True,user_id='6d41f99b92eb4835b48e237cd6187482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:42:05 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Creating volume c7a36949-17e6-4fe4-a744-f385e947687b {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:42:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:05 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:05 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:05 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:42:05 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:42:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c7a36949-17e6-4fe4-a744-f385e947687b 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:05 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d473f0-9d23-412b-830c-36f14fd49f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60c241eb-0a49-4645-8656-93ade2b89e4a', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:05 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca751ae-4fde-407f-b3ae-b02454fc28f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:05 devstack sudo[89283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c7a36949-17e6-4fe4-a744-f385e947687b 1073741824 Apr 10 10:42:05 devstack sudo[89283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:05 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Volume volume-60c241eb-0a49-4645-8656-93ade2b89e4a (60c241eb-0a49-4645-8656-93ade2b89e4a): created successfully Apr 10 10:42:05 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca751ae-4fde-407f-b3ae-b02454fc28f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:05 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Flow 'volume_create_manager' (e5efce09-0039-47e0-9c99-67150829cc3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:05 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-3dbba95c-c6df-4ac1-a5de-5618c0b782bd tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Created volume successfully. Apr 10 10:42:05 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f42134d0-deaa-43b5-bd6f-bad2840c920f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Acquiring lock "cinder-60c241eb-0a49-4645-8656-93ade2b89e4a-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:05 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f42134d0-deaa-43b5-bd6f-bad2840c920f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "cinder-60c241eb-0a49-4645-8656-93ade2b89e4a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:05 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f42134d0-deaa-43b5-bd6f-bad2840c920f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Acquiring lock "cinder-quobyte-60c241eb-0a49-4645-8656-93ade2b89e4a" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:05 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f42134d0-deaa-43b5-bd6f-bad2840c920f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "cinder-quobyte-60c241eb-0a49-4645-8656-93ade2b89e4a" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:05 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5bc93d-338c-4214-9de8-3f2e32cec125]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f42134d0-deaa-43b5-bd6f-bad2840c920f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-60c241eb-0a49-4645-8656-93ade2b89e4a {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:05 devstack sudo[89283]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c7a36949-17e6-4fe4-a744-f385e947687b 1073741824" returned: 0 in 0.692s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:05 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c7a36949-17e6-4fe4-a744-f385e947687b {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:05 devstack sudo[89289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c7a36949-17e6-4fe4-a744-f385e947687b Apr 10 10:42:05 devstack sudo[89289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:05 devstack sudo[89288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-60c241eb-0a49-4645-8656-93ade2b89e4a Apr 10 10:42:05 devstack sudo[89288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:06 devstack sudo[89288]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f42134d0-deaa-43b5-bd6f-bad2840c920f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-60c241eb-0a49-4645-8656-93ade2b89e4a" returned: 0 in 0.533s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f42134d0-deaa-43b5-bd6f-bad2840c920f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-60c241eb-0a49-4645-8656-93ade2b89e4a {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:06 devstack sudo[89296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-60c241eb-0a49-4645-8656-93ade2b89e4a Apr 10 10:42:06 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:06 devstack sudo[89289]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c7a36949-17e6-4fe4-a744-f385e947687b" returned: 0 in 0.598s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:06 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:42:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.978s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:06 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-347216124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1500b797-860b-4f8c-969f-812aa0252e7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f04d6ace1945009b5b39b99bd0f2b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:58Z,use_quota=True,user_id='6d41f99b92eb4835b48e237cd6187482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:42:06 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Creating volume 1500b797-860b-4f8c-969f-812aa0252e7f {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:42:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:06 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:06 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:06 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:42:06 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:42:06 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1500b797-860b-4f8c-969f-812aa0252e7f 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:06 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5e511ca-7c99-4746-8847-58f9a3d26f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7a36949-17e6-4fe4-a744-f385e947687b', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:06 devstack sudo[89298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1500b797-860b-4f8c-969f-812aa0252e7f 1073741824 Apr 10 10:42:06 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:06 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31df4210-49d0-484b-898b-382a8fcd9a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:06 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Volume volume-c7a36949-17e6-4fe4-a744-f385e947687b (c7a36949-17e6-4fe4-a744-f385e947687b): created successfully Apr 10 10:42:06 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31df4210-49d0-484b-898b-382a8fcd9a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:06 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Flow 'volume_create_manager' (69ba36eb-e25b-4ac3-9758-a26842bdb730) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:06 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-92086d54-166c-4b73-b6b0-a8208c30cf99 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Created volume successfully. Apr 10 10:42:07 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f42134d0-deaa-43b5-bd6f-bad2840c920f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-60c241eb-0a49-4645-8656-93ade2b89e4a" returned: 0 in 0.599s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:07 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f42134d0-deaa-43b5-bd6f-bad2840c920f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "cinder-quobyte-60c241eb-0a49-4645-8656-93ade2b89e4a" released by "delete_volume" :: held 1.161s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:07 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-f42134d0-deaa-43b5-bd6f-bad2840c920f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Created reservations ['4cc72451-a727-46d6-8a0d-50922c083f56', '9ad617a0-05a9-47a2-8eba-b98b9422eec0', 'fde9a6e9-d075-4362-ba7e-a2305800fe25', 'c043fe13-8af9-407c-9ef8-851574475e24'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f42134d0-deaa-43b5-bd6f-bad2840c920f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f42134d0-deaa-43b5-bd6f-bad2840c920f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f42134d0-deaa-43b5-bd6f-bad2840c920f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-f42134d0-deaa-43b5-bd6f-bad2840c920f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-f42134d0-deaa-43b5-bd6f-bad2840c920f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f42134d0-deaa-43b5-bd6f-bad2840c920f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:07 devstack sudo[89304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:42:07 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:07 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1500b797-860b-4f8c-969f-812aa0252e7f 1073741824" returned: 0 in 0.599s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1500b797-860b-4f8c-969f-812aa0252e7f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:07 devstack sudo[89306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1500b797-860b-4f8c-969f-812aa0252e7f Apr 10 10:42:07 devstack sudo[89306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:07 devstack sudo[89306]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1500b797-860b-4f8c-969f-812aa0252e7f" returned: 0 in 0.483s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:42:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.938s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1208894129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ccedc10-d9ec-4bb2-896f-686ac6e5b447,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f04d6ace1945009b5b39b99bd0f2b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:59Z,use_quota=True,user_id='6d41f99b92eb4835b48e237cd6187482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:42:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Creating volume 7ccedc10-d9ec-4bb2-896f-686ac6e5b447 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:42:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:07 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:42:07 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:42:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7ccedc10-d9ec-4bb2-896f-686ac6e5b447 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:07 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:07 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-f42134d0-deaa-43b5-bd6f-bad2840c920f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.567s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:07 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-f42134d0-deaa-43b5-bd6f-bad2840c920f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:07 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-f42134d0-deaa-43b5-bd6f-bad2840c920f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Deleted volume successfully. Apr 10 10:42:07 devstack sudo[89310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7ccedc10-d9ec-4bb2-896f-686ac6e5b447 1073741824 Apr 10 10:42:07 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0bc9060-efd9-4230-8dca-25a2f4775ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1500b797-860b-4f8c-969f-812aa0252e7f', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b539a3-a1ac-4204-9ad9-808ac1494246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:07 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Volume volume-1500b797-860b-4f8c-969f-812aa0252e7f (1500b797-860b-4f8c-969f-812aa0252e7f): created successfully Apr 10 10:42:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b539a3-a1ac-4204-9ad9-808ac1494246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:07 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Flow 'volume_create_manager' (39903742-5474-4c78-b92f-fdd4d0b1d39e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:07 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-f42134d0-deaa-43b5-bd6f-bad2840c920f tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "cinder-60c241eb-0a49-4645-8656-93ade2b89e4a-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:07 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-ebeffe58-7050-4597-b906-f3af2d6d5c28 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Created volume successfully. Apr 10 10:42:08 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-75c862eb-b891-4aa5-a5e1-78839ba8acf9 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Acquiring lock "cinder-6ec363f1-6f00-49d7-981d-a74238081e47-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:08 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-75c862eb-b891-4aa5-a5e1-78839ba8acf9 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "cinder-6ec363f1-6f00-49d7-981d-a74238081e47-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:08 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-75c862eb-b891-4aa5-a5e1-78839ba8acf9 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Acquiring lock "cinder-quobyte-6ec363f1-6f00-49d7-981d-a74238081e47" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:08 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-75c862eb-b891-4aa5-a5e1-78839ba8acf9 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "cinder-quobyte-6ec363f1-6f00-49d7-981d-a74238081e47" acquired by "delete_volume" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:08 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73f427a-a642-4506-8fe8-07540c9c6543]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-75c862eb-b891-4aa5-a5e1-78839ba8acf9 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6ec363f1-6f00-49d7-981d-a74238081e47 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:08 devstack sudo[89312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6ec363f1-6f00-49d7-981d-a74238081e47 Apr 10 10:42:08 devstack sudo[89312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:08 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7ccedc10-d9ec-4bb2-896f-686ac6e5b447 1073741824" returned: 0 in 0.614s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7ccedc10-d9ec-4bb2-896f-686ac6e5b447 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:08 devstack sudo[89317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7ccedc10-d9ec-4bb2-896f-686ac6e5b447 Apr 10 10:42:08 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:08 devstack sudo[89312]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-75c862eb-b891-4aa5-a5e1-78839ba8acf9 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6ec363f1-6f00-49d7-981d-a74238081e47" returned: 0 in 0.597s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-75c862eb-b891-4aa5-a5e1-78839ba8acf9 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6ec363f1-6f00-49d7-981d-a74238081e47 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:08 devstack sudo[89322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6ec363f1-6f00-49d7-981d-a74238081e47 Apr 10 10:42:08 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:08 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7ccedc10-d9ec-4bb2-896f-686ac6e5b447" returned: 0 in 0.478s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:08 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:42:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.821s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:08 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1406508598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec0ee6b5-f572-4d2f-accc-f3feb9bd9aeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f04d6ace1945009b5b39b99bd0f2b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:59Z,use_quota=True,user_id='6d41f99b92eb4835b48e237cd6187482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:42:08 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Creating volume ec0ee6b5-f572-4d2f-accc-f3feb9bd9aeb {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:42:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:08 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:08 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:08 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:42:08 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:42:08 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ec0ee6b5-f572-4d2f-accc-f3feb9bd9aeb 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:08 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d57acda-7307-4ea0-99bf-6f2caffacd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ccedc10-d9ec-4bb2-896f-686ac6e5b447', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:08 devstack sudo[89325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ec0ee6b5-f572-4d2f-accc-f3feb9bd9aeb 1073741824 Apr 10 10:42:08 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:08 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (699edd3f-d53f-4230-9978-5b49fa575516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:08 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Volume volume-7ccedc10-d9ec-4bb2-896f-686ac6e5b447 (7ccedc10-d9ec-4bb2-896f-686ac6e5b447): created successfully Apr 10 10:42:08 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (699edd3f-d53f-4230-9978-5b49fa575516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:08 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Flow 'volume_create_manager' (ff74865e-0cfa-4ea1-8a9c-c329ff3a9bb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:08 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-45caf0fe-ead4-4944-9b32-0e9f91417903 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Created volume successfully. Apr 10 10:42:09 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-75c862eb-b891-4aa5-a5e1-78839ba8acf9 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-6ec363f1-6f00-49d7-981d-a74238081e47" returned: 0 in 0.452s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:09 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-75c862eb-b891-4aa5-a5e1-78839ba8acf9 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "cinder-quobyte-6ec363f1-6f00-49d7-981d-a74238081e47" released by "delete_volume" :: held 1.089s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:09 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-75c862eb-b891-4aa5-a5e1-78839ba8acf9 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Created reservations ['2ca97a18-d7a5-4eef-bab6-015b464a6e6f', '892f2c64-f5ea-4028-adcc-bbf1b3dde796', '47b41648-075f-481a-9c8f-dbc2acc84b48', 'cbc4c36d-88d3-45c7-a8ca-50367892bb0f'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-75c862eb-b891-4aa5-a5e1-78839ba8acf9 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-75c862eb-b891-4aa5-a5e1-78839ba8acf9 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:09 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-75c862eb-b891-4aa5-a5e1-78839ba8acf9 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:09 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-75c862eb-b891-4aa5-a5e1-78839ba8acf9 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-75c862eb-b891-4aa5-a5e1-78839ba8acf9 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-75c862eb-b891-4aa5-a5e1-78839ba8acf9 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:09 devstack sudo[89331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:42:09 devstack sudo[89331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:09 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ec0ee6b5-f572-4d2f-accc-f3feb9bd9aeb 1073741824" returned: 0 in 0.579s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ec0ee6b5-f572-4d2f-accc-f3feb9bd9aeb {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:09 devstack sudo[89333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ec0ee6b5-f572-4d2f-accc-f3feb9bd9aeb Apr 10 10:42:09 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:09 devstack sudo[89331]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-75c862eb-b891-4aa5-a5e1-78839ba8acf9 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.432s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:09 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-75c862eb-b891-4aa5-a5e1-78839ba8acf9 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:09 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-75c862eb-b891-4aa5-a5e1-78839ba8acf9 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Deleted volume successfully. Apr 10 10:42:09 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-75c862eb-b891-4aa5-a5e1-78839ba8acf9 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "cinder-6ec363f1-6f00-49d7-981d-a74238081e47-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:09 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ec0ee6b5-f572-4d2f-accc-f3feb9bd9aeb" returned: 0 in 0.460s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:09 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:42:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.696s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:09 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-915935904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7698a1c7-084c-48c8-b690-1e7c95ac8f65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3f04d6ace1945009b5b39b99bd0f2b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:59Z,use_quota=True,user_id='6d41f99b92eb4835b48e237cd6187482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:42:09 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Creating volume 7698a1c7-084c-48c8-b690-1e7c95ac8f65 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:42:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:09 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:09 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:09 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:42:09 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:42:09 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7698a1c7-084c-48c8-b690-1e7c95ac8f65 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (980c667f-00f2-4d1c-9b07-2403478418ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec0ee6b5-f572-4d2f-accc-f3feb9bd9aeb', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e50eeb33-1c16-40bc-9d76-0da2287b8897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:09 devstack sudo[89337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7698a1c7-084c-48c8-b690-1e7c95ac8f65 1073741824 Apr 10 10:42:09 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:09 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Volume volume-ec0ee6b5-f572-4d2f-accc-f3feb9bd9aeb (ec0ee6b5-f572-4d2f-accc-f3feb9bd9aeb): created successfully Apr 10 10:42:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e50eeb33-1c16-40bc-9d76-0da2287b8897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:09 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Flow 'volume_create_manager' (9b2725dc-aaa5-4960-bd3b-a77fc503336f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:09 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-0a89e276-fbb7-4511-a3a4-b4041219b225 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Created volume successfully. Apr 10 10:42:10 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-81c1f962-5d56-47c7-a32b-14ef18c1a94d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Acquiring lock "cinder-d463964b-0c97-4bbc-bafe-91da4f094cb5-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:10 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-81c1f962-5d56-47c7-a32b-14ef18c1a94d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "cinder-d463964b-0c97-4bbc-bafe-91da4f094cb5-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:10 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-81c1f962-5d56-47c7-a32b-14ef18c1a94d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Acquiring lock "cinder-quobyte-d463964b-0c97-4bbc-bafe-91da4f094cb5" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:10 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-81c1f962-5d56-47c7-a32b-14ef18c1a94d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "cinder-quobyte-d463964b-0c97-4bbc-bafe-91da4f094cb5" acquired by "delete_volume" :: waited 0.011s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:10 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81aa5ea-b472-41bf-981b-0c24bc2a8f06]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-81c1f962-5d56-47c7-a32b-14ef18c1a94d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d463964b-0c97-4bbc-bafe-91da4f094cb5 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:10 devstack sudo[89340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d463964b-0c97-4bbc-bafe-91da4f094cb5 Apr 10 10:42:10 devstack sudo[89340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:10 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7698a1c7-084c-48c8-b690-1e7c95ac8f65 1073741824" returned: 0 in 0.667s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7698a1c7-084c-48c8-b690-1e7c95ac8f65 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:10 devstack sudo[89345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7698a1c7-084c-48c8-b690-1e7c95ac8f65 Apr 10 10:42:10 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:10 devstack sudo[89340]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-81c1f962-5d56-47c7-a32b-14ef18c1a94d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d463964b-0c97-4bbc-bafe-91da4f094cb5" returned: 0 in 0.639s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:10 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-81c1f962-5d56-47c7-a32b-14ef18c1a94d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d463964b-0c97-4bbc-bafe-91da4f094cb5 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:10 devstack sudo[89351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d463964b-0c97-4bbc-bafe-91da4f094cb5 Apr 10 10:42:10 devstack sudo[89351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:11 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7698a1c7-084c-48c8-b690-1e7c95ac8f65" returned: 0 in 0.490s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 9.703s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Acquiring lock "cinder-quobyte-ee825c98-c218-45e8-9acc-42c80c3c32be-afd3e9b6-0ff8-4a61-82bd-4422e675304c" by "_create_volume_from_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28abf36-4db2-43cd-9947-1e5deec2f729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7698a1c7-084c-48c8-b690-1e7c95ac8f65', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c42565-27fa-42d4-a483-623e1c35d3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:11 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Volume volume-7698a1c7-084c-48c8-b690-1e7c95ac8f65 (7698a1c7-084c-48c8-b690-1e7c95ac8f65): created successfully Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c42565-27fa-42d4-a483-623e1c35d3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Flow 'volume_create_manager' (2dbbb4b5-8c7e-413e-8af7-64363a825887) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Lock "cinder-quobyte-ee825c98-c218-45e8-9acc-42c80c3c32be-afd3e9b6-0ff8-4a61-82bd-4422e675304c" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Creating volume afd3e9b6-0ff8-4a61-82bd-4422e675304c from snapshot ee825c98-c218-45e8-9acc-42c80c3c32be {{(pid=81938) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Acquiring lock "cinder-quobyte-afd3e9b6-0ff8-4a61-82bd-4422e675304c" by "_copy_volume_from_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:11 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-7938aa53-2a2c-45e1-96ac-f184766138b2 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Created volume successfully. Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Lock "cinder-quobyte-afd3e9b6-0ff8-4a61-82bd-4422e675304c" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] snapshot: ee825c98-c218-45e8-9acc-42c80c3c32be, volume: afd3e9b6-0ff8-4a61-82bd-4422e675304c, {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d95d20-4660-44e7-b5e4-6813933388c2]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d.ee825c98-c218-45e8-9acc-42c80c3c32be {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:11 devstack sudo[89353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d.ee825c98-c218-45e8-9acc-42c80c3c32be Apr 10 10:42:11 devstack sudo[89353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:11 devstack sudo[89351]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-81c1f962-5d56-47c7-a32b-14ef18c1a94d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-d463964b-0c97-4bbc-bafe-91da4f094cb5" returned: 0 in 0.503s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-81c1f962-5d56-47c7-a32b-14ef18c1a94d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "cinder-quobyte-d463964b-0c97-4bbc-bafe-91da4f094cb5" released by "delete_volume" :: held 1.172s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-81c1f962-5d56-47c7-a32b-14ef18c1a94d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Created reservations ['6806da2f-637e-4b84-8e35-4156e0f6d5f5', '434ad9a2-d781-4da6-81a8-81f6f3a4f191', '6e528dc6-fdb4-4dd2-a89b-16dfd5851e27', 'fc03249a-bbc3-4240-9ad6-dd45585cca70'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-81c1f962-5d56-47c7-a32b-14ef18c1a94d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-81c1f962-5d56-47c7-a32b-14ef18c1a94d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-81c1f962-5d56-47c7-a32b-14ef18c1a94d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-81c1f962-5d56-47c7-a32b-14ef18c1a94d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-81c1f962-5d56-47c7-a32b-14ef18c1a94d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-81c1f962-5d56-47c7-a32b-14ef18c1a94d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:11 devstack sudo[89357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:42:11 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:11 devstack sudo[89353]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d.ee825c98-c218-45e8-9acc-42c80c3c32be" returned: 0 in 0.570s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a78b455-89df-4117-aaa8-5c2901d5144d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Creating direct copy from snapshot {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[491fa291-45bb-4108-b197-dcbda1074b1f]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:11 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:11 devstack sudo[89361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d Apr 10 10:42:11 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:12 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a020fe6b-e203-4245-84bc-1d8f917e17b4 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "cinder-7698a1c7-084c-48c8-b690-1e7c95ac8f65-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:12 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a020fe6b-e203-4245-84bc-1d8f917e17b4 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "cinder-7698a1c7-084c-48c8-b690-1e7c95ac8f65-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:12 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a020fe6b-e203-4245-84bc-1d8f917e17b4 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "cinder-quobyte-7698a1c7-084c-48c8-b690-1e7c95ac8f65" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:12 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-81c1f962-5d56-47c7-a32b-14ef18c1a94d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.509s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:12 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-81c1f962-5d56-47c7-a32b-14ef18c1a94d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:12 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-81c1f962-5d56-47c7-a32b-14ef18c1a94d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Deleted volume successfully. Apr 10 10:42:12 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a020fe6b-e203-4245-84bc-1d8f917e17b4 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "cinder-quobyte-7698a1c7-084c-48c8-b690-1e7c95ac8f65" acquired by "delete_volume" :: waited 0.028s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:12 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[2640d898-7e6d-4bf8-9236-adc39bc843b5]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a020fe6b-e203-4245-84bc-1d8f917e17b4 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7698a1c7-084c-48c8-b690-1e7c95ac8f65 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:12 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-81c1f962-5d56-47c7-a32b-14ef18c1a94d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "cinder-d463964b-0c97-4bbc-bafe-91da4f094cb5-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:12 devstack sudo[89364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7698a1c7-084c-48c8-b690-1e7c95ac8f65 Apr 10 10:42:12 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:12 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d" returned: 0 in 0.686s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:12 devstack cinder-volume[81938]: DEBUG cinder.utils [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Path /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-afd3e9b6-0ff8-4a61-82bd-4422e675304c not found in is_blk_device check {{(pid=81938) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:42:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-afd3e9b6-0ff8-4a61-82bd-4422e675304c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:12 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7fa222de-5d82-4f0b-a71d-6594f90db03d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Acquiring lock "cinder-acbaed7c-223c-47dd-82bc-5c2f84183796-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:12 devstack sudo[89369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-afd3e9b6-0ff8-4a61-82bd-4422e675304c Apr 10 10:42:12 devstack sudo[89369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:12 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7fa222de-5d82-4f0b-a71d-6594f90db03d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "cinder-acbaed7c-223c-47dd-82bc-5c2f84183796-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:12 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7fa222de-5d82-4f0b-a71d-6594f90db03d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Acquiring lock "cinder-quobyte-acbaed7c-223c-47dd-82bc-5c2f84183796" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:12 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7fa222de-5d82-4f0b-a71d-6594f90db03d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "cinder-quobyte-acbaed7c-223c-47dd-82bc-5c2f84183796" acquired by "delete_volume" :: waited 0.015s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:12 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e002313-dfd4-43b1-985d-6317bfa4828f]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7fa222de-5d82-4f0b-a71d-6594f90db03d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-acbaed7c-223c-47dd-82bc-5c2f84183796 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:12 devstack sudo[89371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-acbaed7c-223c-47dd-82bc-5c2f84183796 Apr 10 10:42:12 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:12 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a020fe6b-e203-4245-84bc-1d8f917e17b4 tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7698a1c7-084c-48c8-b690-1e7c95ac8f65" returned: 0 in 0.665s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:12 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a020fe6b-e203-4245-84bc-1d8f917e17b4 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7698a1c7-084c-48c8-b690-1e7c95ac8f65 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:12 devstack sudo[89376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7698a1c7-084c-48c8-b690-1e7c95ac8f65 Apr 10 10:42:12 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:13 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7fa222de-5d82-4f0b-a71d-6594f90db03d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-acbaed7c-223c-47dd-82bc-5c2f84183796" returned: 0 in 1.145s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7fa222de-5d82-4f0b-a71d-6594f90db03d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-acbaed7c-223c-47dd-82bc-5c2f84183796 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:13 devstack sudo[89394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-acbaed7c-223c-47dd-82bc-5c2f84183796 Apr 10 10:42:13 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:13 devstack sudo[89394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:13 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a020fe6b-e203-4245-84bc-1d8f917e17b4 tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7698a1c7-084c-48c8-b690-1e7c95ac8f65" returned: 0 in 0.966s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:13 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a020fe6b-e203-4245-84bc-1d8f917e17b4 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "cinder-quobyte-7698a1c7-084c-48c8-b690-1e7c95ac8f65" released by "delete_volume" :: held 1.662s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:13 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-a020fe6b-e203-4245-84bc-1d8f917e17b4 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Created reservations ['9fcaab58-84f8-4ed7-8939-86727fc8f2eb', '8cdf5670-f46d-430b-9c5b-2d51de0bcd78', '41c08a51-5b81-4978-90a1-5741371b2041', 'dc473084-61e9-48aa-ba05-7c2faa37ccdc'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a020fe6b-e203-4245-84bc-1d8f917e17b4 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a020fe6b-e203-4245-84bc-1d8f917e17b4 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:14 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a020fe6b-e203-4245-84bc-1d8f917e17b4 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:14 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a020fe6b-e203-4245-84bc-1d8f917e17b4 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a020fe6b-e203-4245-84bc-1d8f917e17b4 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a020fe6b-e203-4245-84bc-1d8f917e17b4 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:14 devstack sudo[89396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:42:14 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:14 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-2bfe07be-fa77-4e07-8e61-5954dcb39a2d tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "cinder-ec0ee6b5-f572-4d2f-accc-f3feb9bd9aeb-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:14 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-2bfe07be-fa77-4e07-8e61-5954dcb39a2d tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "cinder-ec0ee6b5-f572-4d2f-accc-f3feb9bd9aeb-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:14 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-2bfe07be-fa77-4e07-8e61-5954dcb39a2d tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "cinder-quobyte-ec0ee6b5-f572-4d2f-accc-f3feb9bd9aeb" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:14 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-2bfe07be-fa77-4e07-8e61-5954dcb39a2d tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "cinder-quobyte-ec0ee6b5-f572-4d2f-accc-f3feb9bd9aeb" acquired by "delete_volume" :: waited 0.022s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:14 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d89d2f3-f3bf-45d1-928f-78354613ba6d]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2bfe07be-fa77-4e07-8e61-5954dcb39a2d tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ec0ee6b5-f572-4d2f-accc-f3feb9bd9aeb {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:14 devstack sudo[89399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ec0ee6b5-f572-4d2f-accc-f3feb9bd9aeb Apr 10 10:42:14 devstack sudo[89399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:14 devstack sudo[89394]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:14 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7fa222de-5d82-4f0b-a71d-6594f90db03d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-acbaed7c-223c-47dd-82bc-5c2f84183796" returned: 0 in 1.242s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:14 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7fa222de-5d82-4f0b-a71d-6594f90db03d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "cinder-quobyte-acbaed7c-223c-47dd-82bc-5c2f84183796" released by "delete_volume" :: held 2.437s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:14 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a020fe6b-e203-4245-84bc-1d8f917e17b4 tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.820s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:15 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-a020fe6b-e203-4245-84bc-1d8f917e17b4 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:15 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-a020fe6b-e203-4245-84bc-1d8f917e17b4 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Deleted volume successfully. Apr 10 10:42:15 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a020fe6b-e203-4245-84bc-1d8f917e17b4 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "cinder-7698a1c7-084c-48c8-b690-1e7c95ac8f65-delete_volume" released by "delete_volume" :: held 3.053s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:15 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-7fa222de-5d82-4f0b-a71d-6594f90db03d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Created reservations ['406b79d3-41cf-4144-846c-41a9fc33b82f', '722fba24-d3a1-47b4-8951-3b3202e6858c', '0c85cae4-ac8e-485c-b29c-86bc4179749e', '0cd2a828-cb61-4524-b471-34c3d8421b65'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7fa222de-5d82-4f0b-a71d-6594f90db03d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7fa222de-5d82-4f0b-a71d-6594f90db03d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:15 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7fa222de-5d82-4f0b-a71d-6594f90db03d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:15 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7fa222de-5d82-4f0b-a71d-6594f90db03d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7fa222de-5d82-4f0b-a71d-6594f90db03d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7fa222de-5d82-4f0b-a71d-6594f90db03d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:15 devstack sudo[89402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:42:15 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:15 devstack sudo[89369]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-afd3e9b6-0ff8-4a61-82bd-4422e675304c" returned: 0 in 2.877s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:15 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acdc503-4d5a-4946-bac6-a1b9eb621612]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:15 devstack sudo[89404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d Apr 10 10:42:15 devstack sudo[89404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:15 devstack sudo[89399]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2bfe07be-fa77-4e07-8e61-5954dcb39a2d tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ec0ee6b5-f572-4d2f-accc-f3feb9bd9aeb" returned: 0 in 0.921s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2bfe07be-fa77-4e07-8e61-5954dcb39a2d tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ec0ee6b5-f572-4d2f-accc-f3feb9bd9aeb {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:15 devstack sudo[89409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ec0ee6b5-f572-4d2f-accc-f3feb9bd9aeb Apr 10 10:42:15 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:15 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:15 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7fa222de-5d82-4f0b-a71d-6594f90db03d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.704s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:15 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-7fa222de-5d82-4f0b-a71d-6594f90db03d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:15 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-7fa222de-5d82-4f0b-a71d-6594f90db03d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Deleted volume successfully. Apr 10 10:42:15 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-7fa222de-5d82-4f0b-a71d-6594f90db03d tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "cinder-acbaed7c-223c-47dd-82bc-5c2f84183796-delete_volume" released by "delete_volume" :: held 3.468s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:15 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-144823ab-ed57-495c-9fa6-c6348f3acb48 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Acquiring lock "cinder-e05ea640-c9b4-4c50-95c7-a3c152f59894-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:15 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-144823ab-ed57-495c-9fa6-c6348f3acb48 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "cinder-e05ea640-c9b4-4c50-95c7-a3c152f59894-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:16 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-144823ab-ed57-495c-9fa6-c6348f3acb48 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Acquiring lock "cinder-quobyte-e05ea640-c9b4-4c50-95c7-a3c152f59894" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:16 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-144823ab-ed57-495c-9fa6-c6348f3acb48 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "cinder-quobyte-e05ea640-c9b4-4c50-95c7-a3c152f59894" acquired by "delete_volume" :: waited 0.015s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:16 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ab1418-a8b1-4859-882b-9cc24b20b81a]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-144823ab-ed57-495c-9fa6-c6348f3acb48 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e05ea640-c9b4-4c50-95c7-a3c152f59894 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:16 devstack sudo[89414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e05ea640-c9b4-4c50-95c7-a3c152f59894 Apr 10 10:42:16 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:16 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2bfe07be-fa77-4e07-8e61-5954dcb39a2d tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-ec0ee6b5-f572-4d2f-accc-f3feb9bd9aeb" returned: 0 in 0.622s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:16 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-2bfe07be-fa77-4e07-8e61-5954dcb39a2d tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "cinder-quobyte-ec0ee6b5-f572-4d2f-accc-f3feb9bd9aeb" released by "delete_volume" :: held 1.588s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:16 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-2bfe07be-fa77-4e07-8e61-5954dcb39a2d tempest-CreateVolumesFromSnapshotTest-1988960030 None] Created reservations ['32c6cf6b-f38e-444c-b72b-40aba3064b51', '29bb02ec-3d3c-47a2-a903-fbae67a20548', 'f229ae7c-5457-4fd7-88a6-5bf7a45ba2ae', 'acd7f9f7-f6a9-4fc3-bf62-5f66963d2c27'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-2bfe07be-fa77-4e07-8e61-5954dcb39a2d tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-2bfe07be-fa77-4e07-8e61-5954dcb39a2d tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:16 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-2bfe07be-fa77-4e07-8e61-5954dcb39a2d tempest-CreateVolumesFromSnapshotTest-1988960030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:16 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-2bfe07be-fa77-4e07-8e61-5954dcb39a2d tempest-CreateVolumesFromSnapshotTest-1988960030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-2bfe07be-fa77-4e07-8e61-5954dcb39a2d tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2bfe07be-fa77-4e07-8e61-5954dcb39a2d tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:16 devstack sudo[89418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:42:16 devstack sudo[89418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:16 devstack sudo[89404]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d" returned: 0 in 1.138s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:16 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d, size 1024.00 MB, duration 2.88 sec, destination /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-afd3e9b6-0ff8-4a61-82bd-4422e675304c {{(pid=81938) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:42:16 devstack cinder-volume[81938]: INFO cinder.image.image_utils [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Converted 1024.00 MB image at 355.77 MB/s Apr 10 10:42:16 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-afd3e9b6-0ff8-4a61-82bd-4422e675304c is being set with open permissions: ugo+rw Apr 10 10:42:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-afd3e9b6-0ff8-4a61-82bd-4422e675304c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:16 devstack sudo[89420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-afd3e9b6-0ff8-4a61-82bd-4422e675304c Apr 10 10:42:16 devstack sudo[89420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:16 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-144823ab-ed57-495c-9fa6-c6348f3acb48 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e05ea640-c9b4-4c50-95c7-a3c152f59894" returned: 0 in 0.587s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-144823ab-ed57-495c-9fa6-c6348f3acb48 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e05ea640-c9b4-4c50-95c7-a3c152f59894 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:16 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e05ea640-c9b4-4c50-95c7-a3c152f59894 Apr 10 10:42:16 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:16 devstack sudo[89418]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:16 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-2bfe07be-fa77-4e07-8e61-5954dcb39a2d tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.539s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:16 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-2bfe07be-fa77-4e07-8e61-5954dcb39a2d tempest-CreateVolumesFromSnapshotTest-1988960030 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:16 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-2bfe07be-fa77-4e07-8e61-5954dcb39a2d tempest-CreateVolumesFromSnapshotTest-1988960030 None] Deleted volume successfully. Apr 10 10:42:16 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-2bfe07be-fa77-4e07-8e61-5954dcb39a2d tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "cinder-ec0ee6b5-f572-4d2f-accc-f3feb9bd9aeb-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:16 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-02efe0b1-8a8f-4d17-9c34-3a25d16f0f24 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "cinder-7ccedc10-d9ec-4bb2-896f-686ac6e5b447-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:16 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-02efe0b1-8a8f-4d17-9c34-3a25d16f0f24 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "cinder-7ccedc10-d9ec-4bb2-896f-686ac6e5b447-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-02efe0b1-8a8f-4d17-9c34-3a25d16f0f24 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "cinder-quobyte-7ccedc10-d9ec-4bb2-896f-686ac6e5b447" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-02efe0b1-8a8f-4d17-9c34-3a25d16f0f24 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "cinder-quobyte-7ccedc10-d9ec-4bb2-896f-686ac6e5b447" acquired by "delete_volume" :: waited 0.015s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf4cde4-f2d9-4ca9-bf35-f70ab0a1691c]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-02efe0b1-8a8f-4d17-9c34-3a25d16f0f24 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7ccedc10-d9ec-4bb2-896f-686ac6e5b447 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:17 devstack sudo[89420]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-afd3e9b6-0ff8-4a61-82bd-4422e675304c" returned: 0 in 0.607s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Lock "cinder-quobyte-afd3e9b6-0ff8-4a61-82bd-4422e675304c" released by "_copy_volume_from_snapshot" :: held 5.942s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Lock "cinder-quobyte-ee825c98-c218-45e8-9acc-42c80c3c32be-afd3e9b6-0ff8-4a61-82bd-4422e675304c" released by "_create_volume_from_snapshot" :: held 5.964s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94f0ca5-92bb-4eb5-97d9-bf3aece0ae72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afd3e9b6-0ff8-4a61-82bd-4422e675304c', 'volume_size': 1, 'snapshot_id': 'ee825c98-c218-45e8-9acc-42c80c3c32be'}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:17 devstack sudo[89429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7ccedc10-d9ec-4bb2-896f-686ac6e5b447 Apr 10 10:42:17 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a519c9-17cc-405b-ab4d-05abb491728f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:17 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Volume volume-afd3e9b6-0ff8-4a61-82bd-4422e675304c (afd3e9b6-0ff8-4a61-82bd-4422e675304c): created successfully Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a519c9-17cc-405b-ab4d-05abb491728f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Flow 'volume_create_manager' (9d1f519c-fc64-4110-bc3c-1fc16cb9e9ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:17 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-b69abd86-9c6a-420b-94d7-2f3f7e92eb68 tempest-VolumeDependencyTests-421615573 None] Created volume successfully. Apr 10 10:42:17 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-144823ab-ed57-495c-9fa6-c6348f3acb48 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e05ea640-c9b4-4c50-95c7-a3c152f59894" returned: 0 in 0.573s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-144823ab-ed57-495c-9fa6-c6348f3acb48 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "cinder-quobyte-e05ea640-c9b4-4c50-95c7-a3c152f59894" released by "delete_volume" :: held 1.185s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-144823ab-ed57-495c-9fa6-c6348f3acb48 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Created reservations ['1c51843b-1259-4740-80a2-122479c1add4', '1e680dda-42c5-42cb-8b8b-40f281225bcf', '2d1727cc-0c1e-427a-9efa-ff70566c9add', '22ef4cad-9261-4059-b18a-ab2c14530aab'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-144823ab-ed57-495c-9fa6-c6348f3acb48 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-144823ab-ed57-495c-9fa6-c6348f3acb48 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-144823ab-ed57-495c-9fa6-c6348f3acb48 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-144823ab-ed57-495c-9fa6-c6348f3acb48 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-144823ab-ed57-495c-9fa6-c6348f3acb48 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-144823ab-ed57-495c-9fa6-c6348f3acb48 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:17 devstack sudo[89432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:42:17 devstack sudo[89432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-ede0c1bb-8ae9-44cb-87b6-8ac4cdec5d50 tempest-VolumeDependencyTests-421615573 None] Acquiring lock "cinder-ee825c98-c218-45e8-9acc-42c80c3c32be-delete_snapshot" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-ede0c1bb-8ae9-44cb-87b6-8ac4cdec5d50 tempest-VolumeDependencyTests-421615573 None] Lock "cinder-ee825c98-c218-45e8-9acc-42c80c3c32be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-ede0c1bb-8ae9-44cb-87b6-8ac4cdec5d50 tempest-VolumeDependencyTests-421615573 None] Acquiring lock "cinder-quobyte-7a78b455-89df-4117-aaa8-5c2901d5144d" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-ede0c1bb-8ae9-44cb-87b6-8ac4cdec5d50 tempest-VolumeDependencyTests-421615573 None] Lock "cinder-quobyte-7a78b455-89df-4117-aaa8-5c2901d5144d" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-ede0c1bb-8ae9-44cb-87b6-8ac4cdec5d50 tempest-VolumeDependencyTests-421615573 None] Acquiring lock "cinder-quobyte-ee825c98-c218-45e8-9acc-42c80c3c32be" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-ede0c1bb-8ae9-44cb-87b6-8ac4cdec5d50 tempest-VolumeDependencyTests-421615573 None] Lock "cinder-quobyte-ee825c98-c218-45e8-9acc-42c80c3c32be" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-ede0c1bb-8ae9-44cb-87b6-8ac4cdec5d50 tempest-VolumeDependencyTests-421615573 None] Deleting offline snapshot ee825c98-c218-45e8-9acc-42c80c3c32be of volume 7a78b455-89df-4117-aaa8-5c2901d5144d {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-ede0c1bb-8ae9-44cb-87b6-8ac4cdec5d50 tempest-VolumeDependencyTests-421615573 None] snapshot_file for this snap is: volume-7a78b455-89df-4117-aaa8-5c2901d5144d.ee825c98-c218-45e8-9acc-42c80c3c32be {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9b130d-bf35-4967-87af-167025d06ef4]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-ede0c1bb-8ae9-44cb-87b6-8ac4cdec5d50 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d.ee825c98-c218-45e8-9acc-42c80c3c32be {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:17 devstack sudo[89434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d.ee825c98-c218-45e8-9acc-42c80c3c32be Apr 10 10:42:17 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:17 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-02efe0b1-8a8f-4d17-9c34-3a25d16f0f24 tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7ccedc10-d9ec-4bb2-896f-686ac6e5b447" returned: 0 in 0.589s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-02efe0b1-8a8f-4d17-9c34-3a25d16f0f24 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7ccedc10-d9ec-4bb2-896f-686ac6e5b447 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:17 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7ccedc10-d9ec-4bb2-896f-686ac6e5b447 Apr 10 10:42:17 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:17 devstack sudo[89432]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-144823ab-ed57-495c-9fa6-c6348f3acb48 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.465s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-144823ab-ed57-495c-9fa6-c6348f3acb48 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:17 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-144823ab-ed57-495c-9fa6-c6348f3acb48 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Deleted volume successfully. Apr 10 10:42:17 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-144823ab-ed57-495c-9fa6-c6348f3acb48 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "cinder-e05ea640-c9b4-4c50-95c7-a3c152f59894-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:18 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-ede0c1bb-8ae9-44cb-87b6-8ac4cdec5d50 tempest-VolumeDependencyTests-421615573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d.ee825c98-c218-45e8-9acc-42c80c3c32be" returned: 0 in 0.587s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:18 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-ede0c1bb-8ae9-44cb-87b6-8ac4cdec5d50 tempest-VolumeDependencyTests-421615573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a78b455-89df-4117-aaa8-5c2901d5144d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:42:18 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[45938df1-48da-41e0-b123-d2232aaf3c97]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-ede0c1bb-8ae9-44cb-87b6-8ac4cdec5d50 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:18 devstack sudo[89446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d Apr 10 10:42:18 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:18 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-02efe0b1-8a8f-4d17-9c34-3a25d16f0f24 tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7ccedc10-d9ec-4bb2-896f-686ac6e5b447" returned: 0 in 0.536s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:18 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-02efe0b1-8a8f-4d17-9c34-3a25d16f0f24 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "cinder-quobyte-7ccedc10-d9ec-4bb2-896f-686ac6e5b447" released by "delete_volume" :: held 1.155s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:18 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a0543e87-8404-4723-aaed-dfede1c55f02 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Acquiring lock "cinder-cdea615c-08f6-411b-b475-b3ea58da510f-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:18 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-02efe0b1-8a8f-4d17-9c34-3a25d16f0f24 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Created reservations ['80f2a70f-4900-4531-b4bb-d9ad4e302647', '732c2755-686f-4e08-8572-aeb5cb164b0d', 'ce7c86ae-0203-44cc-9478-c22c12b71cfe', '63a487bc-6fdb-49b8-931b-b31648ef5d60'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:18 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a0543e87-8404-4723-aaed-dfede1c55f02 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "cinder-cdea615c-08f6-411b-b475-b3ea58da510f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-02efe0b1-8a8f-4d17-9c34-3a25d16f0f24 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-02efe0b1-8a8f-4d17-9c34-3a25d16f0f24 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:18 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-02efe0b1-8a8f-4d17-9c34-3a25d16f0f24 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:18 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-02efe0b1-8a8f-4d17-9c34-3a25d16f0f24 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-02efe0b1-8a8f-4d17-9c34-3a25d16f0f24 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-02efe0b1-8a8f-4d17-9c34-3a25d16f0f24 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:18 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a0543e87-8404-4723-aaed-dfede1c55f02 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Acquiring lock "cinder-quobyte-cdea615c-08f6-411b-b475-b3ea58da510f" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:18 devstack sudo[89448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:42:18 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:18 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a0543e87-8404-4723-aaed-dfede1c55f02 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "cinder-quobyte-cdea615c-08f6-411b-b475-b3ea58da510f" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:18 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4e0162-03d9-45a5-9022-d92d64f08a66]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a0543e87-8404-4723-aaed-dfede1c55f02 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cdea615c-08f6-411b-b475-b3ea58da510f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:18 devstack sudo[89450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cdea615c-08f6-411b-b475-b3ea58da510f Apr 10 10:42:18 devstack sudo[89450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:18 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-ede0c1bb-8ae9-44cb-87b6-8ac4cdec5d50 tempest-VolumeDependencyTests-421615573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d" returned: 0 in 0.566s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-ede0c1bb-8ae9-44cb-87b6-8ac4cdec5d50 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d.ee825c98-c218-45e8-9acc-42c80c3c32be {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:18 devstack sudo[89455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d.ee825c98-c218-45e8-9acc-42c80c3c32be Apr 10 10:42:18 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:18 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-02efe0b1-8a8f-4d17-9c34-3a25d16f0f24 tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.478s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:18 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-02efe0b1-8a8f-4d17-9c34-3a25d16f0f24 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:18 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-02efe0b1-8a8f-4d17-9c34-3a25d16f0f24 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Deleted volume successfully. Apr 10 10:42:18 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-02efe0b1-8a8f-4d17-9c34-3a25d16f0f24 tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "cinder-7ccedc10-d9ec-4bb2-896f-686ac6e5b447-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:18 devstack sudo[89450]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a0543e87-8404-4723-aaed-dfede1c55f02 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cdea615c-08f6-411b-b475-b3ea58da510f" returned: 0 in 0.537s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:18 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a0543e87-8404-4723-aaed-dfede1c55f02 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cdea615c-08f6-411b-b475-b3ea58da510f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:18 devstack sudo[89461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cdea615c-08f6-411b-b475-b3ea58da510f Apr 10 10:42:18 devstack sudo[89461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:19 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-28750df2-722d-4e7d-8e31-7ee68d1e6c0a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "cinder-1500b797-860b-4f8c-969f-812aa0252e7f-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:19 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-28750df2-722d-4e7d-8e31-7ee68d1e6c0a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "cinder-1500b797-860b-4f8c-969f-812aa0252e7f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:19 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-28750df2-722d-4e7d-8e31-7ee68d1e6c0a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "cinder-quobyte-1500b797-860b-4f8c-969f-812aa0252e7f" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:19 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-28750df2-722d-4e7d-8e31-7ee68d1e6c0a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "cinder-quobyte-1500b797-860b-4f8c-969f-812aa0252e7f" acquired by "delete_volume" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:19 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6ec422-7b08-4005-a28d-a6e59f6d0fdd]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-28750df2-722d-4e7d-8e31-7ee68d1e6c0a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1500b797-860b-4f8c-969f-812aa0252e7f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:19 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-ede0c1bb-8ae9-44cb-87b6-8ac4cdec5d50 tempest-VolumeDependencyTests-421615573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d.ee825c98-c218-45e8-9acc-42c80c3c32be" returned: 0 in 0.589s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-ede0c1bb-8ae9-44cb-87b6-8ac4cdec5d50 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d.ee825c98-c218-45e8-9acc-42c80c3c32be {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:19 devstack sudo[89467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d.ee825c98-c218-45e8-9acc-42c80c3c32be Apr 10 10:42:19 devstack sudo[89467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:19 devstack sudo[89466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1500b797-860b-4f8c-969f-812aa0252e7f Apr 10 10:42:19 devstack sudo[89466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:19 devstack sudo[89461]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a0543e87-8404-4723-aaed-dfede1c55f02 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-cdea615c-08f6-411b-b475-b3ea58da510f" returned: 0 in 0.463s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:19 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a0543e87-8404-4723-aaed-dfede1c55f02 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "cinder-quobyte-cdea615c-08f6-411b-b475-b3ea58da510f" released by "delete_volume" :: held 1.034s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:19 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-a0543e87-8404-4723-aaed-dfede1c55f02 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Created reservations ['ec0ab749-f568-4683-95a0-a32f4934dd46', '22d3ea39-c4a9-4563-9e43-d618c8f31451', '158d205b-3442-40b8-ae77-e6118c5d83de', '3d39d48b-ddda-4cd8-88a8-c45154367f52'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a0543e87-8404-4723-aaed-dfede1c55f02 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a0543e87-8404-4723-aaed-dfede1c55f02 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:19 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a0543e87-8404-4723-aaed-dfede1c55f02 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:19 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a0543e87-8404-4723-aaed-dfede1c55f02 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a0543e87-8404-4723-aaed-dfede1c55f02 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a0543e87-8404-4723-aaed-dfede1c55f02 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:19 devstack sudo[89471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:42:19 devstack sudo[89471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:19 devstack sudo[89467]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-ede0c1bb-8ae9-44cb-87b6-8ac4cdec5d50 tempest-VolumeDependencyTests-421615573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d.ee825c98-c218-45e8-9acc-42c80c3c32be" returned: 0 in 0.529s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:19 devstack sudo[89466]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:19 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-ede0c1bb-8ae9-44cb-87b6-8ac4cdec5d50 tempest-VolumeDependencyTests-421615573 None] Lock "cinder-quobyte-ee825c98-c218-45e8-9acc-42c80c3c32be" released by "_delete_snapshot" :: held 2.357s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-28750df2-722d-4e7d-8e31-7ee68d1e6c0a tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1500b797-860b-4f8c-969f-812aa0252e7f" returned: 0 in 0.572s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-28750df2-722d-4e7d-8e31-7ee68d1e6c0a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1500b797-860b-4f8c-969f-812aa0252e7f {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:19 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-ede0c1bb-8ae9-44cb-87b6-8ac4cdec5d50 tempest-VolumeDependencyTests-421615573 None] Lock "cinder-quobyte-7a78b455-89df-4117-aaa8-5c2901d5144d" released by "delete_snapshot" :: held 2.382s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:19 devstack sudo[89477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1500b797-860b-4f8c-969f-812aa0252e7f Apr 10 10:42:19 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:19 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-ede0c1bb-8ae9-44cb-87b6-8ac4cdec5d50 tempest-VolumeDependencyTests-421615573 None] Created reservations ['4981dd13-2ff3-47c5-ab48-d3f609d5d99e', '258cf72b-d90d-4c6e-a981-278779398859', 'ecb7f63f-eea6-4c7f-9e76-d8fdb6d321d3', '9916547e-48cc-4c43-b1e6-d3e9f911dd2f'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:19 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-ede0c1bb-8ae9-44cb-87b6-8ac4cdec5d50 tempest-VolumeDependencyTests-421615573 None] Delete snapshot completed successfully. Apr 10 10:42:19 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-ede0c1bb-8ae9-44cb-87b6-8ac4cdec5d50 tempest-VolumeDependencyTests-421615573 None] Lock "cinder-ee825c98-c218-45e8-9acc-42c80c3c32be-delete_snapshot" released by "delete_snapshot" :: held 2.477s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:19 devstack sudo[89471]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:19 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a0543e87-8404-4723-aaed-dfede1c55f02 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.505s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:19 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-a0543e87-8404-4723-aaed-dfede1c55f02 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:19 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-a0543e87-8404-4723-aaed-dfede1c55f02 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Deleted volume successfully. Apr 10 10:42:19 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a0543e87-8404-4723-aaed-dfede1c55f02 tempest-CreateVolumesFromSourceVolumeTest-1580075313 None] Lock "cinder-cdea615c-08f6-411b-b475-b3ea58da510f-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:20 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-28750df2-722d-4e7d-8e31-7ee68d1e6c0a tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-1500b797-860b-4f8c-969f-812aa0252e7f" returned: 0 in 0.456s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:20 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-28750df2-722d-4e7d-8e31-7ee68d1e6c0a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "cinder-quobyte-1500b797-860b-4f8c-969f-812aa0252e7f" released by "delete_volume" :: held 1.053s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:20 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-28750df2-722d-4e7d-8e31-7ee68d1e6c0a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Created reservations ['4aa39b8d-69de-4f9f-af31-bb2aecfcdc4a', 'f74762cf-d28e-4b14-ada7-ab149847dfeb', 'f3030040-4671-4d82-9114-c57eebe2d10f', 'a3669f35-307b-433f-b45a-20ea2c490760'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-28750df2-722d-4e7d-8e31-7ee68d1e6c0a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-28750df2-722d-4e7d-8e31-7ee68d1e6c0a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:20 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-28750df2-722d-4e7d-8e31-7ee68d1e6c0a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:20 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-28750df2-722d-4e7d-8e31-7ee68d1e6c0a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-28750df2-722d-4e7d-8e31-7ee68d1e6c0a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-28750df2-722d-4e7d-8e31-7ee68d1e6c0a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:20 devstack sudo[89482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:42:20 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:20 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-18a27583-0ae9-4917-a57a-a35ed426c4d1 tempest-VolumeDependencyTests-421615573 None] Acquiring lock "cinder-7a78b455-89df-4117-aaa8-5c2901d5144d-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:20 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-18a27583-0ae9-4917-a57a-a35ed426c4d1 tempest-VolumeDependencyTests-421615573 None] Lock "cinder-7a78b455-89df-4117-aaa8-5c2901d5144d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:20 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-18a27583-0ae9-4917-a57a-a35ed426c4d1 tempest-VolumeDependencyTests-421615573 None] Acquiring lock "cinder-quobyte-7a78b455-89df-4117-aaa8-5c2901d5144d" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:20 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-18a27583-0ae9-4917-a57a-a35ed426c4d1 tempest-VolumeDependencyTests-421615573 None] Lock "cinder-quobyte-7a78b455-89df-4117-aaa8-5c2901d5144d" acquired by "delete_volume" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:20 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a1ea36-814d-47f2-8bcf-70576780c434]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-18a27583-0ae9-4917-a57a-a35ed426c4d1 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:20 devstack sudo[89484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d Apr 10 10:42:20 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:20 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:20 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-28750df2-722d-4e7d-8e31-7ee68d1e6c0a tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.554s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:20 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-28750df2-722d-4e7d-8e31-7ee68d1e6c0a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:20 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-28750df2-722d-4e7d-8e31-7ee68d1e6c0a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Deleted volume successfully. Apr 10 10:42:20 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-28750df2-722d-4e7d-8e31-7ee68d1e6c0a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "cinder-1500b797-860b-4f8c-969f-812aa0252e7f-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b0c73675-6bc3-4afe-844b-08b2dca7ab1a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "cinder-c7a36949-17e6-4fe4-a744-f385e947687b-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b0c73675-6bc3-4afe-844b-08b2dca7ab1a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "cinder-c7a36949-17e6-4fe4-a744-f385e947687b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b0c73675-6bc3-4afe-844b-08b2dca7ab1a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "cinder-quobyte-c7a36949-17e6-4fe4-a744-f385e947687b" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:21 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b0c73675-6bc3-4afe-844b-08b2dca7ab1a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "cinder-quobyte-c7a36949-17e6-4fe4-a744-f385e947687b" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:21 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82d7281-5ce5-4336-bbbe-e93883860cf0]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b0c73675-6bc3-4afe-844b-08b2dca7ab1a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c7a36949-17e6-4fe4-a744-f385e947687b {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:21 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-18a27583-0ae9-4917-a57a-a35ed426c4d1 tempest-VolumeDependencyTests-421615573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d" returned: 0 in 0.762s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:21 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-18a27583-0ae9-4917-a57a-a35ed426c4d1 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:21 devstack sudo[89491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d Apr 10 10:42:21 devstack sudo[89491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:21 devstack sudo[89490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c7a36949-17e6-4fe4-a744-f385e947687b Apr 10 10:42:21 devstack sudo[89490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:22 devstack sudo[89491]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-18a27583-0ae9-4917-a57a-a35ed426c4d1 tempest-VolumeDependencyTests-421615573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-7a78b455-89df-4117-aaa8-5c2901d5144d" returned: 0 in 0.657s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-18a27583-0ae9-4917-a57a-a35ed426c4d1 tempest-VolumeDependencyTests-421615573 None] Lock "cinder-quobyte-7a78b455-89df-4117-aaa8-5c2901d5144d" released by "delete_volume" :: held 1.465s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:22 devstack sudo[89490]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b0c73675-6bc3-4afe-844b-08b2dca7ab1a tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c7a36949-17e6-4fe4-a744-f385e947687b" returned: 0 in 0.755s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b0c73675-6bc3-4afe-844b-08b2dca7ab1a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c7a36949-17e6-4fe4-a744-f385e947687b {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-18a27583-0ae9-4917-a57a-a35ed426c4d1 tempest-VolumeDependencyTests-421615573 None] Created reservations ['08682857-2f41-413f-aa65-24cd78390131', '3814ba5e-ab85-4aa5-afd3-ccb36195c8a1', '85533f10-17e5-47af-bdcd-da8d53f346b4', '0a9326b7-cad1-4fc0-a409-eb08abeb70f4'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:22 devstack sudo[89498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c7a36949-17e6-4fe4-a744-f385e947687b Apr 10 10:42:22 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-18a27583-0ae9-4917-a57a-a35ed426c4d1 tempest-VolumeDependencyTests-421615573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-18a27583-0ae9-4917-a57a-a35ed426c4d1 tempest-VolumeDependencyTests-421615573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-18a27583-0ae9-4917-a57a-a35ed426c4d1 tempest-VolumeDependencyTests-421615573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-18a27583-0ae9-4917-a57a-a35ed426c4d1 tempest-VolumeDependencyTests-421615573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-18a27583-0ae9-4917-a57a-a35ed426c4d1 tempest-VolumeDependencyTests-421615573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-18a27583-0ae9-4917-a57a-a35ed426c4d1 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:22 devstack sudo[89500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:42:22 devstack sudo[89500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] Flow 'volume_create_manager' (c1ac92b8-e4da-42ad-82ab-6b1c5318e4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f723ff-31d4-4430-9acf-e62ac63ff5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f723ff-31d4-4430-9acf-e62ac63ff5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96bcb133-b998-4b3e-a639-1ab3d9be1f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16eca8ef65344ccb35ee14119a571c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:42:23Z,use_quota=True,user_id='ec4e8c94e30e4be699bcfdeedcd9dc90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35aa8b84-dd58-401e-b491-d1cefd5bd1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35aa8b84-dd58-401e-b491-d1cefd5bd1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caf032ec-5f43-4ff6-bbe1-127643b42d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:22 devstack sudo[89500]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caf032ec-5f43-4ff6-bbe1-127643b42d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96bcb133-b998-4b3e-a639-1ab3d9be1f1a', 'volume_name': 'volume-96bcb133-b998-4b3e-a639-1ab3d9be1f1a', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bbcccd9-96e3-41b3-9bf9-835af83f1316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bbcccd9-96e3-41b3-9bf9-835af83f1316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef332259-aa03-46b9-81bd-ca9a3fc87f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:22 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] Volume 96bcb133-b998-4b3e-a639-1ab3d9be1f1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96bcb133-b998-4b3e-a639-1ab3d9be1f1a', 'volume_size': 1} Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96bcb133-b998-4b3e-a639-1ab3d9be1f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16eca8ef65344ccb35ee14119a571c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:42:23Z,use_quota=True,user_id='ec4e8c94e30e4be699bcfdeedcd9dc90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] Creating volume 96bcb133-b998-4b3e-a639-1ab3d9be1f1a {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:42:22 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-96bcb133-b998-4b3e-a639-1ab3d9be1f1a 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-18a27583-0ae9-4917-a57a-a35ed426c4d1 tempest-VolumeDependencyTests-421615573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.653s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-18a27583-0ae9-4917-a57a-a35ed426c4d1 tempest-VolumeDependencyTests-421615573 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:22 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-18a27583-0ae9-4917-a57a-a35ed426c4d1 tempest-VolumeDependencyTests-421615573 None] Deleted volume successfully. Apr 10 10:42:22 devstack sudo[89505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-96bcb133-b998-4b3e-a639-1ab3d9be1f1a 1073741824 Apr 10 10:42:22 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-18a27583-0ae9-4917-a57a-a35ed426c4d1 tempest-VolumeDependencyTests-421615573 None] Lock "cinder-7a78b455-89df-4117-aaa8-5c2901d5144d-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:22 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:23 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b0c73675-6bc3-4afe-844b-08b2dca7ab1a tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-c7a36949-17e6-4fe4-a744-f385e947687b" returned: 0 in 0.828s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b0c73675-6bc3-4afe-844b-08b2dca7ab1a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "cinder-quobyte-c7a36949-17e6-4fe4-a744-f385e947687b" released by "delete_volume" :: held 1.605s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-b0c73675-6bc3-4afe-844b-08b2dca7ab1a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Created reservations ['6adf0aec-1793-46eb-bde1-77f837db2a0f', '643a2522-c274-4534-bd08-0079a0300acc', '21208dac-81dd-4cfc-ab65-3d564ca1d61d', '606b4d68-e0c9-4846-bfcd-136d4295e841'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b0c73675-6bc3-4afe-844b-08b2dca7ab1a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b0c73675-6bc3-4afe-844b-08b2dca7ab1a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b0c73675-6bc3-4afe-844b-08b2dca7ab1a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b0c73675-6bc3-4afe-844b-08b2dca7ab1a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b0c73675-6bc3-4afe-844b-08b2dca7ab1a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b0c73675-6bc3-4afe-844b-08b2dca7ab1a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:23 devstack sudo[89507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:42:23 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] Flow 'volume_create_manager' (757f481f-4280-4ccf-87cf-7de88374eaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7979e13-a0dc-4eb1-8bd9-de4b539a7763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7979e13-a0dc-4eb1-8bd9-de4b539a7763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-611734078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14281303-1944-4045-ae5f-11325d11cf78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f270f4de02f476fac3ad759b5c0e75f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:42:23Z,use_quota=True,user_id='63fbc81099794683a95d08b5b17d020d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3691bf31-b81a-4e7a-931d-6437662d6397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3691bf31-b81a-4e7a-931d-6437662d6397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54efd3c6-2621-445d-8017-1cfbe09c9433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54efd3c6-2621-445d-8017-1cfbe09c9433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14281303-1944-4045-ae5f-11325d11cf78', 'volume_name': 'volume-14281303-1944-4045-ae5f-11325d11cf78', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa1de42-9371-4fb9-9d9d-cb5ea0035df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa1de42-9371-4fb9-9d9d-cb5ea0035df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (647935e9-65d5-4c02-bead-336f234e5f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:23 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] Volume 14281303-1944-4045-ae5f-11325d11cf78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14281303-1944-4045-ae5f-11325d11cf78', 'volume_size': 1} Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:23 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-96bcb133-b998-4b3e-a639-1ab3d9be1f1a 1073741824" returned: 0 in 0.617s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-96bcb133-b998-4b3e-a639-1ab3d9be1f1a {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:23 devstack sudo[89512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-96bcb133-b998-4b3e-a639-1ab3d9be1f1a Apr 10 10:42:23 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6d5b8187-1b9b-497f-b5cd-16853eb95f8a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "cinder-0bea8ae5-0e8d-407c-9a3a-f75d8639a178-delete_snapshot" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6d5b8187-1b9b-497f-b5cd-16853eb95f8a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "cinder-0bea8ae5-0e8d-407c-9a3a-f75d8639a178-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6d5b8187-1b9b-497f-b5cd-16853eb95f8a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "cinder-quobyte-e057fb64-b0ff-4cb9-9b69-e40140ca4a79" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6d5b8187-1b9b-497f-b5cd-16853eb95f8a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "cinder-quobyte-e057fb64-b0ff-4cb9-9b69-e40140ca4a79" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6d5b8187-1b9b-497f-b5cd-16853eb95f8a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "cinder-quobyte-0bea8ae5-0e8d-407c-9a3a-f75d8639a178" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6d5b8187-1b9b-497f-b5cd-16853eb95f8a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "cinder-quobyte-0bea8ae5-0e8d-407c-9a3a-f75d8639a178" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-6d5b8187-1b9b-497f-b5cd-16853eb95f8a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Deleting offline snapshot 0bea8ae5-0e8d-407c-9a3a-f75d8639a178 of volume e057fb64-b0ff-4cb9-9b69-e40140ca4a79 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-6d5b8187-1b9b-497f-b5cd-16853eb95f8a tempest-CreateVolumesFromSnapshotTest-1988960030 None] snapshot_file for this snap is: volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79.0bea8ae5-0e8d-407c-9a3a-f75d8639a178 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[677d218f-2573-4c2b-ac68-958b434d9f4d]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6d5b8187-1b9b-497f-b5cd-16853eb95f8a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79.0bea8ae5-0e8d-407c-9a3a-f75d8639a178 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:23 devstack sudo[89514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79.0bea8ae5-0e8d-407c-9a3a-f75d8639a178 Apr 10 10:42:23 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:23 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b0c73675-6bc3-4afe-844b-08b2dca7ab1a tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.638s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-b0c73675-6bc3-4afe-844b-08b2dca7ab1a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:23 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-b0c73675-6bc3-4afe-844b-08b2dca7ab1a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Deleted volume successfully. Apr 10 10:42:23 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b0c73675-6bc3-4afe-844b-08b2dca7ab1a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "cinder-c7a36949-17e6-4fe4-a744-f385e947687b-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:24 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-96bcb133-b998-4b3e-a639-1ab3d9be1f1a" returned: 0 in 0.546s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:24 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:42:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.766s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:24 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-611734078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14281303-1944-4045-ae5f-11325d11cf78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f270f4de02f476fac3ad759b5c0e75f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:42:23Z,use_quota=True,user_id='63fbc81099794683a95d08b5b17d020d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:42:24 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] Creating volume 14281303-1944-4045-ae5f-11325d11cf78 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:42:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:24 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:24 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:24 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:42:24 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:42:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:24 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef332259-aa03-46b9-81bd-ca9a3fc87f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96bcb133-b998-4b3e-a639-1ab3d9be1f1a', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:24 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78 1073741824 Apr 10 10:42:24 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:24 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2634163d-b7d5-45c0-ac40-badc78c52b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:24 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] Volume volume-96bcb133-b998-4b3e-a639-1ab3d9be1f1a (96bcb133-b998-4b3e-a639-1ab3d9be1f1a): created successfully Apr 10 10:42:24 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2634163d-b7d5-45c0-ac40-badc78c52b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:24 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] Flow 'volume_create_manager' (c1ac92b8-e4da-42ad-82ab-6b1c5318e4c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:24 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-1307a7e7-0934-4d3d-b577-587fe149c222 tempest-CinderUnicodeTest-1800741968 None] Created volume successfully. Apr 10 10:42:24 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6d5b8187-1b9b-497f-b5cd-16853eb95f8a tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79.0bea8ae5-0e8d-407c-9a3a-f75d8639a178" returned: 0 in 0.620s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:24 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-6d5b8187-1b9b-497f-b5cd-16853eb95f8a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:42:24 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[107b4a7f-146c-4658-b1be-f197f994cab3]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6d5b8187-1b9b-497f-b5cd-16853eb95f8a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:24 devstack sudo[89523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79 Apr 10 10:42:24 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:24 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78 1073741824" returned: 0 in 0.596s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:24 devstack sudo[89529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78 Apr 10 10:42:24 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:24 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6d5b8187-1b9b-497f-b5cd-16853eb95f8a tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79" returned: 0 in 0.605s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:24 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6d5b8187-1b9b-497f-b5cd-16853eb95f8a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79.0bea8ae5-0e8d-407c-9a3a-f75d8639a178 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:24 devstack sudo[89533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79.0bea8ae5-0e8d-407c-9a3a-f75d8639a178 Apr 10 10:42:24 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:25 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] Flow 'volume_create_manager' (db6bf744-66ae-4788-81f9-49ad5390246e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe55bfea-5468-4487-9713-47a6e8137af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78" returned: 0 in 0.605s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe55bfea-5468-4487-9713-47a6e8137af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:42:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-216508239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e33eb9cf-8bd1-4d2c-92c0-c192c070cd50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16eca8ef65344ccb35ee14119a571c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:42:25Z,use_quota=True,user_id='ec4e8c94e30e4be699bcfdeedcd9dc90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff38946-3342-4869-adcc-9c98a90f2726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff38946-3342-4869-adcc-9c98a90f2726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79d5258a-fbe1-4cad-b474-ab68cd87622f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79d5258a-fbe1-4cad-b474-ab68cd87622f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e33eb9cf-8bd1-4d2c-92c0-c192c070cd50', 'volume_name': 'volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab32d6df-202a-4726-9eb5-f8e1d625a59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab32d6df-202a-4726-9eb5-f8e1d625a59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ffbd093-2755-4eac-8a4b-81326fcfdbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:25 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] Volume e33eb9cf-8bd1-4d2c-92c0-c192c070cd50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50', 'volume_size': 1} Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:42:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-216508239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e33eb9cf-8bd1-4d2c-92c0-c192c070cd50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16eca8ef65344ccb35ee14119a571c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:42:25Z,use_quota=True,user_id='ec4e8c94e30e4be699bcfdeedcd9dc90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] Creating volume e33eb9cf-8bd1-4d2c-92c0-c192c070cd50 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:42:25 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (647935e9-65d5-4c02-bead-336f234e5f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14281303-1944-4045-ae5f-11325d11cf78', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (debfc201-9186-4716-b466-5310640a059d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:25 devstack sudo[89539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50 1073741824 Apr 10 10:42:25 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:25 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] Volume volume-14281303-1944-4045-ae5f-11325d11cf78 (14281303-1944-4045-ae5f-11325d11cf78): created successfully Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (debfc201-9186-4716-b466-5310640a059d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] Flow 'volume_create_manager' (757f481f-4280-4ccf-87cf-7de88374eaa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:25 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-37e89232-0721-4a79-924e-86385878f6c6 tempest-VolumeDependencyTests-421615573 None] Created volume successfully. Apr 10 10:42:25 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6d5b8187-1b9b-497f-b5cd-16853eb95f8a tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79.0bea8ae5-0e8d-407c-9a3a-f75d8639a178" returned: 0 in 0.618s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6d5b8187-1b9b-497f-b5cd-16853eb95f8a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79.0bea8ae5-0e8d-407c-9a3a-f75d8639a178 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:25 devstack sudo[89541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79.0bea8ae5-0e8d-407c-9a3a-f75d8639a178 Apr 10 10:42:25 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:25 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50 1073741824" returned: 0 in 0.527s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:25 devstack sudo[89547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50 Apr 10 10:42:25 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:25 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:25 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-6d5b8187-1b9b-497f-b5cd-16853eb95f8a tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79.0bea8ae5-0e8d-407c-9a3a-f75d8639a178" returned: 0 in 0.465s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6d5b8187-1b9b-497f-b5cd-16853eb95f8a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "cinder-quobyte-0bea8ae5-0e8d-407c-9a3a-f75d8639a178" released by "_delete_snapshot" :: held 2.371s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6d5b8187-1b9b-497f-b5cd-16853eb95f8a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "cinder-quobyte-e057fb64-b0ff-4cb9-9b69-e40140ca4a79" released by "delete_snapshot" :: held 2.385s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-6d5b8187-1b9b-497f-b5cd-16853eb95f8a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Created reservations ['3447b8cc-f05d-46d4-9974-f03dd4c51b9e', '3b4a39d1-72d1-49df-a9fd-d04c9d6e6609', 'af5f3a15-45b9-4132-bae5-2fa54db11d9e', '7f8b065d-bd37-4890-87b4-cf0bf78d1ba3'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:26 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-6d5b8187-1b9b-497f-b5cd-16853eb95f8a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Delete snapshot completed successfully. Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-6d5b8187-1b9b-497f-b5cd-16853eb95f8a tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "cinder-0bea8ae5-0e8d-407c-9a3a-f75d8639a178-delete_snapshot" released by "delete_snapshot" :: held 2.479s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:26 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50" returned: 0 in 0.414s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ffbd093-2755-4eac-8a4b-81326fcfdbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba034bba-2543-4f79-830c-e01d5a58ca2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:26 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] Volume volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50 (e33eb9cf-8bd1-4d2c-92c0-c192c070cd50): created successfully Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba034bba-2543-4f79-830c-e01d5a58ca2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] Flow 'volume_create_manager' (db6bf744-66ae-4788-81f9-49ad5390246e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:26 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-3f549243-add0-4530-b548-a475a211941c tempest-CinderUnicodeTest-1800741968 None] Created volume successfully. Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-dba1174f-9546-455c-b9cf-9d335decccae tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "cinder-e057fb64-b0ff-4cb9-9b69-e40140ca4a79-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Flow 'volume_create_manager' (5cfdd296-82b5-494c-8037-8d59463e88cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf62d003-6698-43f7-8b73-7a2f5cac096f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-dba1174f-9546-455c-b9cf-9d335decccae tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "cinder-e057fb64-b0ff-4cb9-9b69-e40140ca4a79-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf62d003-6698-43f7-8b73-7a2f5cac096f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-531692574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8502d56-2921-4d69-97c2-3637f937b30d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f270f4de02f476fac3ad759b5c0e75f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=14281303-1944-4045-ae5f-11325d11cf78,status='creating',terminated_at=None,updated_at=2026-04-10T08:42:27Z,use_quota=True,user_id='63fbc81099794683a95d08b5b17d020d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583d29fb-4dbe-472a-804f-92f7b6a5f0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583d29fb-4dbe-472a-804f-92f7b6a5f0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c925c6e7-3133-4903-a8f2-2afe055f600c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-dba1174f-9546-455c-b9cf-9d335decccae tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "cinder-quobyte-e057fb64-b0ff-4cb9-9b69-e40140ca4a79" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c925c6e7-3133-4903-a8f2-2afe055f600c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e8502d56-2921-4d69-97c2-3637f937b30d', 'volume_name': 'volume-e8502d56-2921-4d69-97c2-3637f937b30d', 'volume_size': 1, 'source_volid': '14281303-1944-4045-ae5f-11325d11cf78', 'source_volstatus': 'available'}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1ef0ded-06a2-44ec-8de8-174060c83d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1ef0ded-06a2-44ec-8de8-174060c83d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (653d97ce-0ad1-4f63-8f41-e767a85c8407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:26 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Volume e8502d56-2921-4d69-97c2-3637f937b30d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e8502d56-2921-4d69-97c2-3637f937b30d', 'volume_size': 1, 'source_volid': '14281303-1944-4045-ae5f-11325d11cf78', 'source_volstatus': 'available'} Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:26 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Cloning volume 14281303-1944-4045-ae5f-11325d11cf78 to volume e8502d56-2921-4d69-97c2-3637f937b30d Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-dba1174f-9546-455c-b9cf-9d335decccae tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "cinder-quobyte-e057fb64-b0ff-4cb9-9b69-e40140ca4a79" acquired by "delete_volume" :: waited 0.034s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c1bbb0-8bfe-41f9-8085-9dbe2c6f7004]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dba1174f-9546-455c-b9cf-9d335decccae tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Creating offline snapshot f2e1a345-20db-46d1-99d0-0bff93e3842d of volume 14281303-1944-4045-ae5f-11325d11cf78 {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc6e821-bc63-4122-aa03-a5301b8d031a]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:26 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:26 devstack sudo[89550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79 Apr 10 10:42:26 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:27 devstack sudo[89551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78 Apr 10 10:42:27 devstack sudo[89551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:27 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:42:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] Flow 'volume_create_manager' (cebbfd64-7013-4d2d-aeed-48e347c06ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dcb6a4c-4ac1-4b6e-a507-ac48800528f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dcb6a4c-4ac1-4b6e-a507-ac48800528f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-551096879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb90916b-f37c-4ca4-81d9-321cc5c27557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c01d81e941f423cb57894b619f5e3fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:42:27Z,use_quota=True,user_id='70ad3a0832644d39a83556c31fc4c674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8641b579-2a45-4310-a515-8c00027812bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8641b579-2a45-4310-a515-8c00027812bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d3919f4-0336-422f-b71a-abc719334512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d3919f4-0336-422f-b71a-abc719334512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb90916b-f37c-4ca4-81d9-321cc5c27557', 'volume_name': 'volume-eb90916b-f37c-4ca4-81d9-321cc5c27557', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d990c346-a181-4aef-ba44-0a15684da066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d990c346-a181-4aef-ba44-0a15684da066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:27 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0123812-e54c-4514-b2a1-a66ee04bdd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:27 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] Volume eb90916b-f37c-4ca4-81d9-321cc5c27557: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb90916b-f37c-4ca4-81d9-321cc5c27557', 'volume_size': 1} Apr 10 10:42:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:27 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dba1174f-9546-455c-b9cf-9d335decccae tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79" returned: 0 in 0.582s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:27 devstack sudo[89551]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dba1174f-9546-455c-b9cf-9d335decccae tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78" returned: 0 in 0.557s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78.f2e1a345-20db-46d1-99d0-0bff93e3842d 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:27 devstack sudo[89560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79 Apr 10 10:42:27 devstack sudo[89560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:27 devstack sudo[89561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78.f2e1a345-20db-46d1-99d0-0bff93e3842d 1G Apr 10 10:42:27 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-4d690e64-1523-4739-8c84-fdf3295310b5 tempest-CinderUnicodeTest-1800741968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:27 devstack sudo[89560]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dba1174f-9546-455c-b9cf-9d335decccae tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e057fb64-b0ff-4cb9-9b69-e40140ca4a79" returned: 0 in 0.428s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:27 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-dba1174f-9546-455c-b9cf-9d335decccae tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "cinder-quobyte-e057fb64-b0ff-4cb9-9b69-e40140ca4a79" released by "delete_volume" :: held 1.040s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:27 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-dba1174f-9546-455c-b9cf-9d335decccae tempest-CreateVolumesFromSnapshotTest-1988960030 None] Created reservations ['db23f650-1447-4f7d-a142-596a68a15fcf', 'f9d2d1dc-465a-4875-b906-5101ed363a1a', '58a02984-8051-4a04-93c9-643b54c4c2a8', 'a42b37f9-8443-40cb-aa50-c62c46b813ac'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-dba1174f-9546-455c-b9cf-9d335decccae tempest-CreateVolumesFromSnapshotTest-1988960030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-dba1174f-9546-455c-b9cf-9d335decccae tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:27 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-dba1174f-9546-455c-b9cf-9d335decccae tempest-CreateVolumesFromSnapshotTest-1988960030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:27 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-dba1174f-9546-455c-b9cf-9d335decccae tempest-CreateVolumesFromSnapshotTest-1988960030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-dba1174f-9546-455c-b9cf-9d335decccae tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:27 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dba1174f-9546-455c-b9cf-9d335decccae tempest-CreateVolumesFromSnapshotTest-1988960030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:28 devstack sudo[89568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:42:28 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:28 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78.f2e1a345-20db-46d1-99d0-0bff93e3842d 1G" returned: 0 in 0.553s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14281303-1944-4045-ae5f-11325d11cf78 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78.f2e1a345-20db-46d1-99d0-0bff93e3842d {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:28 devstack sudo[89570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14281303-1944-4045-ae5f-11325d11cf78 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78.f2e1a345-20db-46d1-99d0-0bff93e3842d Apr 10 10:42:28 devstack sudo[89570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:28 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-dba1174f-9546-455c-b9cf-9d335decccae tempest-CreateVolumesFromSnapshotTest-1988960030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.407s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:28 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-dba1174f-9546-455c-b9cf-9d335decccae tempest-CreateVolumesFromSnapshotTest-1988960030 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:28 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-dba1174f-9546-455c-b9cf-9d335decccae tempest-CreateVolumesFromSnapshotTest-1988960030 None] Deleted volume successfully. Apr 10 10:42:28 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-dba1174f-9546-455c-b9cf-9d335decccae tempest-CreateVolumesFromSnapshotTest-1988960030 None] Lock "cinder-e057fb64-b0ff-4cb9-9b69-e40140ca4a79-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:28 devstack sudo[89570]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14281303-1944-4045-ae5f-11325d11cf78 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78.f2e1a345-20db-46d1-99d0-0bff93e3842d" returned: 0 in 0.426s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:28 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78.f2e1a345-20db-46d1-99d0-0bff93e3842d is being set with open permissions: ugo+rw Apr 10 10:42:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78.f2e1a345-20db-46d1-99d0-0bff93e3842d {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:28 devstack sudo[89576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78.f2e1a345-20db-46d1-99d0-0bff93e3842d Apr 10 10:42:28 devstack sudo[89576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:28 devstack sudo[89576]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78.f2e1a345-20db-46d1-99d0-0bff93e3842d" returned: 0 in 0.397s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:28 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:28 devstack sudo[89579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78.info Apr 10 10:42:28 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:29 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78.info" returned: 0 in 0.428s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:29 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78.info is being set with open permissions: ugo+rw Apr 10 10:42:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:29 devstack sudo[89582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78.info Apr 10 10:42:29 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:29 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78.info" returned: 0 in 0.455s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:29 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Acquiring lock "cinder-quobyte-e8502d56-2921-4d69-97c2-3637f937b30d" by "_copy_volume_from_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:29 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Lock "cinder-quobyte-e8502d56-2921-4d69-97c2-3637f937b30d" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:29 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] snapshot: f2e1a345-20db-46d1-99d0-0bff93e3842d, volume: e8502d56-2921-4d69-97c2-3637f937b30d, {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:42:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:29 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:29 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:29 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[5375c910-cebf-4bb1-8425-a0fc35a7c465]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:29 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78.f2e1a345-20db-46d1-99d0-0bff93e3842d {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:29 devstack sudo[89585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78.f2e1a345-20db-46d1-99d0-0bff93e3842d Apr 10 10:42:29 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:30 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78.f2e1a345-20db-46d1-99d0-0bff93e3842d" returned: 0 in 0.499s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:30 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14281303-1944-4045-ae5f-11325d11cf78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:42:30 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78 {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:42:30 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Creating direct copy from snapshot {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:42:30 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[3013c242-da56-442c-9bc8-b5b891a65268]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:30 devstack sudo[89591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78 Apr 10 10:42:30 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:30 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78" returned: 0 in 0.461s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:30 devstack cinder-volume[81938]: DEBUG cinder.utils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Path /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e8502d56-2921-4d69-97c2-3637f937b30d not found in is_blk_device check {{(pid=81938) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:42:30 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e8502d56-2921-4d69-97c2-3637f937b30d {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:30 devstack sudo[89596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e8502d56-2921-4d69-97c2-3637f937b30d Apr 10 10:42:30 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:32 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e8502d56-2921-4d69-97c2-3637f937b30d" returned: 0 in 2.017s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:32 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b2bc4b-da2c-4cd3-a457-d4dfef344a0b]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:32 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:32 devstack sudo[89610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78 Apr 10 10:42:32 devstack sudo[89610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:33 devstack sudo[89610]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78" returned: 0 in 0.582s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:33 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78, size 1024.00 MB, duration 2.02 sec, destination /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e8502d56-2921-4d69-97c2-3637f937b30d {{(pid=81938) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:42:33 devstack cinder-volume[81938]: INFO cinder.image.image_utils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Converted 1024.00 MB image at 507.42 MB/s Apr 10 10:42:33 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e8502d56-2921-4d69-97c2-3637f937b30d is being set with open permissions: ugo+rw Apr 10 10:42:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e8502d56-2921-4d69-97c2-3637f937b30d {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:33 devstack sudo[89615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e8502d56-2921-4d69-97c2-3637f937b30d Apr 10 10:42:33 devstack sudo[89615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:33 devstack sudo[89615]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e8502d56-2921-4d69-97c2-3637f937b30d" returned: 0 in 0.446s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:33 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Lock "cinder-quobyte-e8502d56-2921-4d69-97c2-3637f937b30d" released by "_copy_volume_from_snapshot" :: held 4.052s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:33 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Acquiring lock "cinder-quobyte-f2e1a345-20db-46d1-99d0-0bff93e3842d" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:33 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Lock "cinder-quobyte-f2e1a345-20db-46d1-99d0-0bff93e3842d" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:33 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Deleting offline snapshot f2e1a345-20db-46d1-99d0-0bff93e3842d of volume 14281303-1944-4045-ae5f-11325d11cf78 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:42:33 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] snapshot_file for this snap is: volume-14281303-1944-4045-ae5f-11325d11cf78.f2e1a345-20db-46d1-99d0-0bff93e3842d {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:42:33 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68d6e0a-4ebd-4345-8294-526398a2a3e2]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:33 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78.f2e1a345-20db-46d1-99d0-0bff93e3842d {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:33 devstack sudo[89618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78.f2e1a345-20db-46d1-99d0-0bff93e3842d Apr 10 10:42:33 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:34 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78.f2e1a345-20db-46d1-99d0-0bff93e3842d" returned: 0 in 0.465s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:34 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14281303-1944-4045-ae5f-11325d11cf78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:42:34 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[008a66f0-9bed-45f3-948f-a3a512a71d01]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:34 devstack sudo[89623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78 Apr 10 10:42:34 devstack sudo[89623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:34 devstack sudo[89623]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78" returned: 0 in 0.459s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:34 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78.f2e1a345-20db-46d1-99d0-0bff93e3842d {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:34 devstack sudo[89628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78.f2e1a345-20db-46d1-99d0-0bff93e3842d Apr 10 10:42:34 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:35 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78.f2e1a345-20db-46d1-99d0-0bff93e3842d" returned: 0 in 0.460s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78.f2e1a345-20db-46d1-99d0-0bff93e3842d {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:35 devstack sudo[89633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78.f2e1a345-20db-46d1-99d0-0bff93e3842d Apr 10 10:42:35 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:35 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78.f2e1a345-20db-46d1-99d0-0bff93e3842d" returned: 0 in 0.405s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:35 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Lock "cinder-quobyte-f2e1a345-20db-46d1-99d0-0bff93e3842d" released by "_delete_snapshot" :: held 1.833s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.839s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.277s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:35 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-551096879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb90916b-f37c-4ca4-81d9-321cc5c27557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c01d81e941f423cb57894b619f5e3fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:42:27Z,use_quota=True,user_id='70ad3a0832644d39a83556c31fc4c674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)}" {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:42:35 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] Creating volume eb90916b-f37c-4ca4-81d9-321cc5c27557 {{(pid=81938) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:42:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:35 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:35 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:35 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:42:35 devstack cinder-volume[81938]: INFO cinder.volume.drivers.remotefs [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] casted to osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 Apr 10 10:42:35 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557 1073741824 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (653d97ce-0ad1-4f63-8f41-e767a85c8407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8502d56-2921-4d69-97c2-3637f937b30d', 'volume_size': 1, 'source_volid': '14281303-1944-4045-ae5f-11325d11cf78', 'source_volstatus': 'available'}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0c87a2-a738-440f-96a1-945ce1973c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:35 devstack sudo[89636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557 1073741824 Apr 10 10:42:35 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:35 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Volume volume-e8502d56-2921-4d69-97c2-3637f937b30d (e8502d56-2921-4d69-97c2-3637f937b30d): created successfully Apr 10 10:42:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0c87a2-a738-440f-96a1-945ce1973c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:35 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Flow 'volume_create_manager' (5cfdd296-82b5-494c-8037-8d59463e88cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:35 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-366c280a-d833-455d-a9df-6ed3c6fdc673 tempest-VolumeDependencyTests-421615573 None] Created volume successfully. Apr 10 10:42:36 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-449ace0f-413f-41c9-99c3-ab0455c9b4f2 tempest-VolumeDependencyTests-421615573 None] Acquiring lock "cinder-14281303-1944-4045-ae5f-11325d11cf78-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:36 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-449ace0f-413f-41c9-99c3-ab0455c9b4f2 tempest-VolumeDependencyTests-421615573 None] Lock "cinder-14281303-1944-4045-ae5f-11325d11cf78-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:36 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:36 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-449ace0f-413f-41c9-99c3-ab0455c9b4f2 tempest-VolumeDependencyTests-421615573 None] Acquiring lock "cinder-quobyte-14281303-1944-4045-ae5f-11325d11cf78" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557 1073741824" returned: 0 in 0.549s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:36 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-449ace0f-413f-41c9-99c3-ab0455c9b4f2 tempest-VolumeDependencyTests-421615573 None] Lock "cinder-quobyte-14281303-1944-4045-ae5f-11325d11cf78" acquired by "delete_volume" :: waited 0.018s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:36 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc694b74-1920-4322-b93f-1a18f8fde954]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-449ace0f-413f-41c9-99c3-ab0455c9b4f2 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:36 devstack sudo[89642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557 Apr 10 10:42:36 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:36 devstack sudo[89641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78 Apr 10 10:42:36 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:36 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557" returned: 0 in 0.431s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:36 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'} {{(pid=81938) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:42:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-4d690e64-1523-4739-8c84-fdf3295310b5 tempest-CinderUnicodeTest-1800741968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.168s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:36 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-4d690e64-1523-4739-8c84-fdf3295310b5 tempest-CinderUnicodeTest-1800741968 None] Creating offline snapshot f1478f13-840a-4db7-9047-7c9c7c8d4825 of volume e33eb9cf-8bd1-4d2c-92c0-c192c070cd50 {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:42:36 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0123812-e54c-4514-b2a1-a66ee04bdd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb90916b-f37c-4ca4-81d9-321cc5c27557', 'volume_size': 1}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4108c6e3-62ec-4b0a-a0b5-b88217738378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:36 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8e91da-39ca-4f25-8ca6-369468f324f3]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4d690e64-1523-4739-8c84-fdf3295310b5 tempest-CinderUnicodeTest-1800741968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-449ace0f-413f-41c9-99c3-ab0455c9b4f2 tempest-VolumeDependencyTests-421615573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78" returned: 0 in 0.499s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:36 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-449ace0f-413f-41c9-99c3-ab0455c9b4f2 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:36 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] Volume volume-eb90916b-f37c-4ca4-81d9-321cc5c27557 (eb90916b-f37c-4ca4-81d9-321cc5c27557): created successfully Apr 10 10:42:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4108c6e3-62ec-4b0a-a0b5-b88217738378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:36 devstack sudo[89650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78 Apr 10 10:42:36 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:36 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] Flow 'volume_create_manager' (cebbfd64-7013-4d2d-aeed-48e347c06ed9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:36 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-234503d3-973c-423a-aa16-7c02b5b39828 tempest-SnapshotDependencyTests-121212392 None] Created volume successfully. Apr 10 10:42:36 devstack sudo[89649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50 Apr 10 10:42:36 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-05369ef6-e506-448c-bff4-5753b7994005 tempest-SnapshotDependencyTests-121212392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:37 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-449ace0f-413f-41c9-99c3-ab0455c9b4f2 tempest-VolumeDependencyTests-421615573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-14281303-1944-4045-ae5f-11325d11cf78" returned: 0 in 0.465s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:37 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-449ace0f-413f-41c9-99c3-ab0455c9b4f2 tempest-VolumeDependencyTests-421615573 None] Lock "cinder-quobyte-14281303-1944-4045-ae5f-11325d11cf78" released by "delete_volume" :: held 0.991s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:37 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-449ace0f-413f-41c9-99c3-ab0455c9b4f2 tempest-VolumeDependencyTests-421615573 None] Created reservations ['157fd2ef-dbc5-45f4-aa37-2a741b0ff299', '01a0685d-cacd-4ce6-9548-f1e1cbcce8ae', 'b5557bca-f775-4133-9e41-7cba319caa58', '12c05856-2806-4889-95ca-8582f9b5fb10'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:37 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4d690e64-1523-4739-8c84-fdf3295310b5 tempest-CinderUnicodeTest-1800741968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50" returned: 0 in 0.522s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4d690e64-1523-4739-8c84-fdf3295310b5 tempest-CinderUnicodeTest-1800741968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50.f1478f13-840a-4db7-9047-7c9c7c8d4825 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:37 devstack sudo[89657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50.f1478f13-840a-4db7-9047-7c9c7c8d4825 1G Apr 10 10:42:37 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-449ace0f-413f-41c9-99c3-ab0455c9b4f2 tempest-VolumeDependencyTests-421615573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-449ace0f-413f-41c9-99c3-ab0455c9b4f2 tempest-VolumeDependencyTests-421615573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:37 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-449ace0f-413f-41c9-99c3-ab0455c9b4f2 tempest-VolumeDependencyTests-421615573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:37 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-449ace0f-413f-41c9-99c3-ab0455c9b4f2 tempest-VolumeDependencyTests-421615573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-449ace0f-413f-41c9-99c3-ab0455c9b4f2 tempest-VolumeDependencyTests-421615573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-449ace0f-413f-41c9-99c3-ab0455c9b4f2 tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:37 devstack sudo[89659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:42:37 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:37 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-449ace0f-413f-41c9-99c3-ab0455c9b4f2 tempest-VolumeDependencyTests-421615573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.403s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:37 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-449ace0f-413f-41c9-99c3-ab0455c9b4f2 tempest-VolumeDependencyTests-421615573 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:37 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-449ace0f-413f-41c9-99c3-ab0455c9b4f2 tempest-VolumeDependencyTests-421615573 None] Deleted volume successfully. Apr 10 10:42:37 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4d690e64-1523-4739-8c84-fdf3295310b5 tempest-CinderUnicodeTest-1800741968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50.f1478f13-840a-4db7-9047-7c9c7c8d4825 1G" returned: 0 in 0.467s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:37 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4d690e64-1523-4739-8c84-fdf3295310b5 tempest-CinderUnicodeTest-1800741968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50.f1478f13-840a-4db7-9047-7c9c7c8d4825 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:37 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-449ace0f-413f-41c9-99c3-ab0455c9b4f2 tempest-VolumeDependencyTests-421615573 None] Lock "cinder-14281303-1944-4045-ae5f-11325d11cf78-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:37 devstack sudo[89665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50.f1478f13-840a-4db7-9047-7c9c7c8d4825 Apr 10 10:42:37 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:38 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4d690e64-1523-4739-8c84-fdf3295310b5 tempest-CinderUnicodeTest-1800741968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50.f1478f13-840a-4db7-9047-7c9c7c8d4825" returned: 0 in 0.418s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:38 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-4d690e64-1523-4739-8c84-fdf3295310b5 tempest-CinderUnicodeTest-1800741968 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50.f1478f13-840a-4db7-9047-7c9c7c8d4825 is being set with open permissions: ugo+rw Apr 10 10:42:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4d690e64-1523-4739-8c84-fdf3295310b5 tempest-CinderUnicodeTest-1800741968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50.f1478f13-840a-4db7-9047-7c9c7c8d4825 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:38 devstack sudo[89670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50.f1478f13-840a-4db7-9047-7c9c7c8d4825 Apr 10 10:42:38 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:38 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b806043a-894b-46ac-a4de-f1842de4e02c tempest-VolumeDependencyTests-421615573 None] Acquiring lock "cinder-e8502d56-2921-4d69-97c2-3637f937b30d-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:38 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b806043a-894b-46ac-a4de-f1842de4e02c tempest-VolumeDependencyTests-421615573 None] Lock "cinder-e8502d56-2921-4d69-97c2-3637f937b30d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:38 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b806043a-894b-46ac-a4de-f1842de4e02c tempest-VolumeDependencyTests-421615573 None] Acquiring lock "cinder-quobyte-e8502d56-2921-4d69-97c2-3637f937b30d" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:38 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b806043a-894b-46ac-a4de-f1842de4e02c tempest-VolumeDependencyTests-421615573 None] Lock "cinder-quobyte-e8502d56-2921-4d69-97c2-3637f937b30d" acquired by "delete_volume" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:38 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23d6140-15f3-49f4-9334-f4e964b1e54f]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b806043a-894b-46ac-a4de-f1842de4e02c tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e8502d56-2921-4d69-97c2-3637f937b30d {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:38 devstack sudo[89672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e8502d56-2921-4d69-97c2-3637f937b30d Apr 10 10:42:38 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:38 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4d690e64-1523-4739-8c84-fdf3295310b5 tempest-CinderUnicodeTest-1800741968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50.f1478f13-840a-4db7-9047-7c9c7c8d4825" returned: 0 in 0.431s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4d690e64-1523-4739-8c84-fdf3295310b5 tempest-CinderUnicodeTest-1800741968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:38 devstack sudo[89675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50.info Apr 10 10:42:38 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:38 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b806043a-894b-46ac-a4de-f1842de4e02c tempest-VolumeDependencyTests-421615573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e8502d56-2921-4d69-97c2-3637f937b30d" returned: 0 in 0.482s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:38 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b806043a-894b-46ac-a4de-f1842de4e02c tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e8502d56-2921-4d69-97c2-3637f937b30d {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:38 devstack sudo[89680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e8502d56-2921-4d69-97c2-3637f937b30d Apr 10 10:42:38 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:39 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4d690e64-1523-4739-8c84-fdf3295310b5 tempest-CinderUnicodeTest-1800741968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50.info" returned: 0 in 0.431s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:39 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-4d690e64-1523-4739-8c84-fdf3295310b5 tempest-CinderUnicodeTest-1800741968 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50.info is being set with open permissions: ugo+rw Apr 10 10:42:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4d690e64-1523-4739-8c84-fdf3295310b5 tempest-CinderUnicodeTest-1800741968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:39 devstack sudo[89683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50.info Apr 10 10:42:39 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:39 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b806043a-894b-46ac-a4de-f1842de4e02c tempest-VolumeDependencyTests-421615573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e8502d56-2921-4d69-97c2-3637f937b30d" returned: 0 in 0.417s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:39 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b806043a-894b-46ac-a4de-f1842de4e02c tempest-VolumeDependencyTests-421615573 None] Lock "cinder-quobyte-e8502d56-2921-4d69-97c2-3637f937b30d" released by "delete_volume" :: held 0.920s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:39 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-b806043a-894b-46ac-a4de-f1842de4e02c tempest-VolumeDependencyTests-421615573 None] Created reservations ['ff128517-2938-49ba-8873-d37616c48f1e', '9c94d527-2a50-4e43-828e-760019e88c19', 'd3397e70-b394-4411-b4d8-3c9ce17109d7', 'bb2b0301-836a-46d5-afb9-8255414b195f'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b806043a-894b-46ac-a4de-f1842de4e02c tempest-VolumeDependencyTests-421615573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b806043a-894b-46ac-a4de-f1842de4e02c tempest-VolumeDependencyTests-421615573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:39 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b806043a-894b-46ac-a4de-f1842de4e02c tempest-VolumeDependencyTests-421615573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:39 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b806043a-894b-46ac-a4de-f1842de4e02c tempest-VolumeDependencyTests-421615573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b806043a-894b-46ac-a4de-f1842de4e02c tempest-VolumeDependencyTests-421615573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b806043a-894b-46ac-a4de-f1842de4e02c tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:39 devstack sudo[89687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:42:39 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:39 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-4d690e64-1523-4739-8c84-fdf3295310b5 tempest-CinderUnicodeTest-1800741968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50.info" returned: 0 in 0.434s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-4d690e64-1523-4739-8c84-fdf3295310b5 tempest-CinderUnicodeTest-1800741968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.770s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-05369ef6-e506-448c-bff4-5753b7994005 tempest-SnapshotDependencyTests-121212392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.383s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:39 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-05369ef6-e506-448c-bff4-5753b7994005 tempest-SnapshotDependencyTests-121212392 None] Creating offline snapshot fb54e28c-e456-4249-806b-1e46d4f5c116 of volume eb90916b-f37c-4ca4-81d9-321cc5c27557 {{(pid=81938) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:42:39 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-4d690e64-1523-4739-8c84-fdf3295310b5 tempest-CinderUnicodeTest-1800741968 None] Create snapshot completed successfully Apr 10 10:42:39 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[a890246a-705e-476b-b7d9-e3d64c60c22f]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:39 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b3bbf349-eb3a-4bf7-bf88-d3e035cd6c5a tempest-VolumeDependencyTests-421615573 None] Acquiring lock "cinder-afd3e9b6-0ff8-4a61-82bd-4422e675304c-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-05369ef6-e506-448c-bff4-5753b7994005 tempest-SnapshotDependencyTests-121212392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:39 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b3bbf349-eb3a-4bf7-bf88-d3e035cd6c5a tempest-VolumeDependencyTests-421615573 None] Lock "cinder-afd3e9b6-0ff8-4a61-82bd-4422e675304c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:39 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b3bbf349-eb3a-4bf7-bf88-d3e035cd6c5a tempest-VolumeDependencyTests-421615573 None] Acquiring lock "cinder-quobyte-afd3e9b6-0ff8-4a61-82bd-4422e675304c" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:39 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b3bbf349-eb3a-4bf7-bf88-d3e035cd6c5a tempest-VolumeDependencyTests-421615573 None] Lock "cinder-quobyte-afd3e9b6-0ff8-4a61-82bd-4422e675304c" acquired by "delete_volume" :: waited 0.007s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:39 devstack sudo[89689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557 Apr 10 10:42:39 devstack sudo[89689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:39 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[9880cede-51c1-4c37-873c-480a1c53f20e]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b3bbf349-eb3a-4bf7-bf88-d3e035cd6c5a tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-afd3e9b6-0ff8-4a61-82bd-4422e675304c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:39 devstack sudo[89691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-afd3e9b6-0ff8-4a61-82bd-4422e675304c Apr 10 10:42:39 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:39 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:39 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b806043a-894b-46ac-a4de-f1842de4e02c tempest-VolumeDependencyTests-421615573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.460s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:39 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-b806043a-894b-46ac-a4de-f1842de4e02c tempest-VolumeDependencyTests-421615573 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:39 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-b806043a-894b-46ac-a4de-f1842de4e02c tempest-VolumeDependencyTests-421615573 None] Deleted volume successfully. Apr 10 10:42:39 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b806043a-894b-46ac-a4de-f1842de4e02c tempest-VolumeDependencyTests-421615573 None] Lock "cinder-e8502d56-2921-4d69-97c2-3637f937b30d-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:40 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-770cb75e-767d-4997-84ba-7527067c0c76 tempest-CinderUnicodeTest-1800741968 None] Acquiring lock "cinder-f1478f13-840a-4db7-9047-7c9c7c8d4825-delete_snapshot" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:40 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-770cb75e-767d-4997-84ba-7527067c0c76 tempest-CinderUnicodeTest-1800741968 None] Lock "cinder-f1478f13-840a-4db7-9047-7c9c7c8d4825-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:40 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-770cb75e-767d-4997-84ba-7527067c0c76 tempest-CinderUnicodeTest-1800741968 None] Acquiring lock "cinder-quobyte-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:40 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-770cb75e-767d-4997-84ba-7527067c0c76 tempest-CinderUnicodeTest-1800741968 None] Lock "cinder-quobyte-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:40 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-770cb75e-767d-4997-84ba-7527067c0c76 tempest-CinderUnicodeTest-1800741968 None] Acquiring lock "cinder-quobyte-f1478f13-840a-4db7-9047-7c9c7c8d4825" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:40 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-770cb75e-767d-4997-84ba-7527067c0c76 tempest-CinderUnicodeTest-1800741968 None] Lock "cinder-quobyte-f1478f13-840a-4db7-9047-7c9c7c8d4825" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:40 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-770cb75e-767d-4997-84ba-7527067c0c76 tempest-CinderUnicodeTest-1800741968 None] Deleting offline snapshot f1478f13-840a-4db7-9047-7c9c7c8d4825 of volume e33eb9cf-8bd1-4d2c-92c0-c192c070cd50 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:42:40 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-770cb75e-767d-4997-84ba-7527067c0c76 tempest-CinderUnicodeTest-1800741968 None] snapshot_file for this snap is: volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50.f1478f13-840a-4db7-9047-7c9c7c8d4825 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:42:40 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7c6b2e-6d25-4e5f-934b-77d0cb13fbb6]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-770cb75e-767d-4997-84ba-7527067c0c76 tempest-CinderUnicodeTest-1800741968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50.f1478f13-840a-4db7-9047-7c9c7c8d4825 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:40 devstack sudo[89689]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-05369ef6-e506-448c-bff4-5753b7994005 tempest-SnapshotDependencyTests-121212392 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557" returned: 0 in 0.516s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-05369ef6-e506-448c-bff4-5753b7994005 tempest-SnapshotDependencyTests-121212392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557.fb54e28c-e456-4249-806b-1e46d4f5c116 1G {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:40 devstack sudo[89698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50.f1478f13-840a-4db7-9047-7c9c7c8d4825 Apr 10 10:42:40 devstack sudo[89698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:40 devstack sudo[89701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557.fb54e28c-e456-4249-806b-1e46d4f5c116 1G Apr 10 10:42:40 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:40 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b3bbf349-eb3a-4bf7-bf88-d3e035cd6c5a tempest-VolumeDependencyTests-421615573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-afd3e9b6-0ff8-4a61-82bd-4422e675304c" returned: 0 in 0.547s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b3bbf349-eb3a-4bf7-bf88-d3e035cd6c5a tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-afd3e9b6-0ff8-4a61-82bd-4422e675304c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:40 devstack sudo[89705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-afd3e9b6-0ff8-4a61-82bd-4422e675304c Apr 10 10:42:40 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:40 devstack sudo[89698]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-770cb75e-767d-4997-84ba-7527067c0c76 tempest-CinderUnicodeTest-1800741968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50.f1478f13-840a-4db7-9047-7c9c7c8d4825" returned: 0 in 0.504s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:40 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-770cb75e-767d-4997-84ba-7527067c0c76 tempest-CinderUnicodeTest-1800741968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:42:40 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f9839c-f24b-486e-8479-4d53d4c36f62]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-770cb75e-767d-4997-84ba-7527067c0c76 tempest-CinderUnicodeTest-1800741968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:40 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-05369ef6-e506-448c-bff4-5753b7994005 tempest-SnapshotDependencyTests-121212392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557.fb54e28c-e456-4249-806b-1e46d4f5c116 1G" returned: 0 in 0.500s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-05369ef6-e506-448c-bff4-5753b7994005 tempest-SnapshotDependencyTests-121212392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb90916b-f37c-4ca4-81d9-321cc5c27557 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557.fb54e28c-e456-4249-806b-1e46d4f5c116 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:40 devstack sudo[89715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb90916b-f37c-4ca4-81d9-321cc5c27557 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557.fb54e28c-e456-4249-806b-1e46d4f5c116 Apr 10 10:42:40 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:40 devstack sudo[89713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50 Apr 10 10:42:40 devstack sudo[89713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:40 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b3bbf349-eb3a-4bf7-bf88-d3e035cd6c5a tempest-VolumeDependencyTests-421615573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-afd3e9b6-0ff8-4a61-82bd-4422e675304c" returned: 0 in 0.471s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:40 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b3bbf349-eb3a-4bf7-bf88-d3e035cd6c5a tempest-VolumeDependencyTests-421615573 None] Lock "cinder-quobyte-afd3e9b6-0ff8-4a61-82bd-4422e675304c" released by "delete_volume" :: held 1.045s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:40 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-b3bbf349-eb3a-4bf7-bf88-d3e035cd6c5a tempest-VolumeDependencyTests-421615573 None] Created reservations ['7fb02fa4-7c4e-4fff-b866-00d82096849a', 'c1c87f89-5d7f-4713-a2ec-78ef427b9148', '50d7b388-3657-4c08-a67a-d1f498dbb896', '8844b204-2ff9-47d7-87b8-1e796a6f445c'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b3bbf349-eb3a-4bf7-bf88-d3e035cd6c5a tempest-VolumeDependencyTests-421615573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b3bbf349-eb3a-4bf7-bf88-d3e035cd6c5a tempest-VolumeDependencyTests-421615573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:40 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b3bbf349-eb3a-4bf7-bf88-d3e035cd6c5a tempest-VolumeDependencyTests-421615573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:40 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-b3bbf349-eb3a-4bf7-bf88-d3e035cd6c5a tempest-VolumeDependencyTests-421615573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-b3bbf349-eb3a-4bf7-bf88-d3e035cd6c5a tempest-VolumeDependencyTests-421615573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:40 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b3bbf349-eb3a-4bf7-bf88-d3e035cd6c5a tempest-VolumeDependencyTests-421615573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:40 devstack sudo[89718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:42:40 devstack sudo[89718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:41 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-05369ef6-e506-448c-bff4-5753b7994005 tempest-SnapshotDependencyTests-121212392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb90916b-f37c-4ca4-81d9-321cc5c27557 -F qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557.fb54e28c-e456-4249-806b-1e46d4f5c116" returned: 0 in 0.484s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:41 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-05369ef6-e506-448c-bff4-5753b7994005 tempest-SnapshotDependencyTests-121212392 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557.fb54e28c-e456-4249-806b-1e46d4f5c116 is being set with open permissions: ugo+rw Apr 10 10:42:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-05369ef6-e506-448c-bff4-5753b7994005 tempest-SnapshotDependencyTests-121212392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557.fb54e28c-e456-4249-806b-1e46d4f5c116 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:41 devstack sudo[89713]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-770cb75e-767d-4997-84ba-7527067c0c76 tempest-CinderUnicodeTest-1800741968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50" returned: 0 in 0.529s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-770cb75e-767d-4997-84ba-7527067c0c76 tempest-CinderUnicodeTest-1800741968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50.f1478f13-840a-4db7-9047-7c9c7c8d4825 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:41 devstack sudo[89726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557.fb54e28c-e456-4249-806b-1e46d4f5c116 Apr 10 10:42:41 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:41 devstack sudo[89728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50.f1478f13-840a-4db7-9047-7c9c7c8d4825 Apr 10 10:42:41 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:41 devstack sudo[89718]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-b3bbf349-eb3a-4bf7-bf88-d3e035cd6c5a tempest-VolumeDependencyTests-421615573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.428s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:41 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-b3bbf349-eb3a-4bf7-bf88-d3e035cd6c5a tempest-VolumeDependencyTests-421615573 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:41 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-b3bbf349-eb3a-4bf7-bf88-d3e035cd6c5a tempest-VolumeDependencyTests-421615573 None] Deleted volume successfully. Apr 10 10:42:41 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-b3bbf349-eb3a-4bf7-bf88-d3e035cd6c5a tempest-VolumeDependencyTests-421615573 None] Lock "cinder-afd3e9b6-0ff8-4a61-82bd-4422e675304c-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:41 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-05369ef6-e506-448c-bff4-5753b7994005 tempest-SnapshotDependencyTests-121212392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557.fb54e28c-e456-4249-806b-1e46d4f5c116" returned: 0 in 0.430s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-05369ef6-e506-448c-bff4-5753b7994005 tempest-SnapshotDependencyTests-121212392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:41 devstack sudo[89735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557.info Apr 10 10:42:41 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:41 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-770cb75e-767d-4997-84ba-7527067c0c76 tempest-CinderUnicodeTest-1800741968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50.f1478f13-840a-4db7-9047-7c9c7c8d4825" returned: 0 in 0.470s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-770cb75e-767d-4997-84ba-7527067c0c76 tempest-CinderUnicodeTest-1800741968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50.f1478f13-840a-4db7-9047-7c9c7c8d4825 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:41 devstack sudo[89737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50.f1478f13-840a-4db7-9047-7c9c7c8d4825 Apr 10 10:42:41 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:41 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:41 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-770cb75e-767d-4997-84ba-7527067c0c76 tempest-CinderUnicodeTest-1800741968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50.f1478f13-840a-4db7-9047-7c9c7c8d4825" returned: 0 in 0.431s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:42 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-05369ef6-e506-448c-bff4-5753b7994005 tempest-SnapshotDependencyTests-121212392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557.info" returned: 0 in 0.479s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:42 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-05369ef6-e506-448c-bff4-5753b7994005 tempest-SnapshotDependencyTests-121212392 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557.info is being set with open permissions: ugo+rw Apr 10 10:42:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-05369ef6-e506-448c-bff4-5753b7994005 tempest-SnapshotDependencyTests-121212392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557.info {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:42 devstack sudo[89741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557.info Apr 10 10:42:42 devstack sudo[89741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:42 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-770cb75e-767d-4997-84ba-7527067c0c76 tempest-CinderUnicodeTest-1800741968 None] Lock "cinder-quobyte-f1478f13-840a-4db7-9047-7c9c7c8d4825" released by "_delete_snapshot" :: held 2.006s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:42 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-770cb75e-767d-4997-84ba-7527067c0c76 tempest-CinderUnicodeTest-1800741968 None] Lock "cinder-quobyte-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50" released by "delete_snapshot" :: held 2.021s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:42 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-770cb75e-767d-4997-84ba-7527067c0c76 tempest-CinderUnicodeTest-1800741968 None] Created reservations ['5ba3eb21-6792-4c38-abc5-e8896bbd0ed4', '59e7ff8d-475b-42c1-9bae-943fe2845e91', '6a6531f4-b6e3-4243-ab76-5974866c0d64', '5343b5e1-72d6-42df-9220-56a53fa75c42'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:42 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-770cb75e-767d-4997-84ba-7527067c0c76 tempest-CinderUnicodeTest-1800741968 None] Delete snapshot completed successfully. Apr 10 10:42:42 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-770cb75e-767d-4997-84ba-7527067c0c76 tempest-CinderUnicodeTest-1800741968 None] Lock "cinder-f1478f13-840a-4db7-9047-7c9c7c8d4825-delete_snapshot" released by "delete_snapshot" :: held 2.140s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:42 devstack sudo[89741]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-05369ef6-e506-448c-bff4-5753b7994005 tempest-SnapshotDependencyTests-121212392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557.info" returned: 0 in 0.467s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:42 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-05369ef6-e506-448c-bff4-5753b7994005 tempest-SnapshotDependencyTests-121212392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.947s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:42 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writing DB stats cinder:UPDATE=265,cinder:SELECT=194,cinder:DELETE=24,cinder:INSERT=66 {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:42:42 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-05369ef6-e506-448c-bff4-5753b7994005 tempest-SnapshotDependencyTests-121212392 None] Create snapshot completed successfully Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a4d4a189-90fd-41bd-b7d9-a32ffff4886d tempest-CinderUnicodeTest-1800741968 None] Acquiring lock "cinder-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a4d4a189-90fd-41bd-b7d9-a32ffff4886d tempest-CinderUnicodeTest-1800741968 None] Lock "cinder-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writing DB stats cinder:SELECT=181,cinder:UPDATE=261,cinder:INSERT=59,cinder:DELETE=25 {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a4d4a189-90fd-41bd-b7d9-a32ffff4886d tempest-CinderUnicodeTest-1800741968 None] Acquiring lock "cinder-quobyte-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a4d4a189-90fd-41bd-b7d9-a32ffff4886d tempest-CinderUnicodeTest-1800741968 None] Lock "cinder-quobyte-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50" acquired by "delete_volume" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a6ddea-473f-4460-91a1-4780fcf697e6]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a4d4a189-90fd-41bd-b7d9-a32ffff4886d tempest-CinderUnicodeTest-1800741968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:43 devstack sudo[89745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50 Apr 10 10:42:43 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG cinder.volume.flows.manager.create_volume [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81938) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Flow 'volume_create_manager' (c400ab0a-923d-40eb-90c7-df0474971623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e88b02f-93f8-4864-8d1f-4e632cab44fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e88b02f-93f8-4864-8d1f-4e632cab44fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=131c80fa-3737-40a0-abb8-427ae10d8631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c01d81e941f423cb57894b619f5e3fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fb54e28c-e456-4249-806b-1e46d4f5c116,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:42:44Z,use_quota=True,user_id='70ad3a0832644d39a83556c31fc4c674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8d8563d-81e7-4688-bdf0-fb5888e8aa9f),volume_type_id=a8d8563d-81e7-4688-bdf0-fb5888e8aa9f)' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14bb3404-1e0c-4b9b-bdf2-df334003abaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14bb3404-1e0c-4b9b-bdf2-df334003abaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c3350c-a2d2-4c7e-be24-ef39baf2c936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c3350c-a2d2-4c7e-be24-ef39baf2c936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '131c80fa-3737-40a0-abb8-427ae10d8631', 'volume_name': 'volume-131c80fa-3737-40a0-abb8-427ae10d8631', 'volume_size': 1, 'snapshot_id': 'fb54e28c-e456-4249-806b-1e46d4f5c116'}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b00835d7-e598-47ba-a257-28b405cc8c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b00835d7-e598-47ba-a257-28b405cc8c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (709aa788-5c72-4f24-ae6c-912141e43c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:43 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Volume 131c80fa-3737-40a0-abb8-427ae10d8631: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-131c80fa-3737-40a0-abb8-427ae10d8631', 'volume_size': 1, 'snapshot_id': 'fb54e28c-e456-4249-806b-1e46d4f5c116'} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Acquiring lock "cinder-quobyte-fb54e28c-e456-4249-806b-1e46d4f5c116-131c80fa-3737-40a0-abb8-427ae10d8631" by "_create_volume_from_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:43 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a4d4a189-90fd-41bd-b7d9-a32ffff4886d tempest-CinderUnicodeTest-1800741968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50" returned: 0 in 0.543s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a4d4a189-90fd-41bd-b7d9-a32ffff4886d tempest-CinderUnicodeTest-1800741968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Lock "cinder-quobyte-fb54e28c-e456-4249-806b-1e46d4f5c116-131c80fa-3737-40a0-abb8-427ae10d8631" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Creating volume 131c80fa-3737-40a0-abb8-427ae10d8631 from snapshot fb54e28c-e456-4249-806b-1e46d4f5c116 {{(pid=81938) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:43 devstack sudo[89750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50 Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:43 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Selected osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4 as target Quobyte volume. {{(pid=81938) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Acquiring lock "cinder-quobyte-131c80fa-3737-40a0-abb8-427ae10d8631" by "_copy_volume_from_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Lock "cinder-quobyte-131c80fa-3737-40a0-abb8-427ae10d8631" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] snapshot: fb54e28c-e456-4249-806b-1e46d4f5c116, volume: 131c80fa-3737-40a0-abb8-427ae10d8631, {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf5a8da-fa21-444f-be78-ba69dc7c22ab]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:43 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557.fb54e28c-e456-4249-806b-1e46d4f5c116 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:43 devstack sudo[89752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557.fb54e28c-e456-4249-806b-1e46d4f5c116 Apr 10 10:42:43 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:44 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a4d4a189-90fd-41bd-b7d9-a32ffff4886d tempest-CinderUnicodeTest-1800741968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50" returned: 0 in 0.400s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:44 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a4d4a189-90fd-41bd-b7d9-a32ffff4886d tempest-CinderUnicodeTest-1800741968 None] Lock "cinder-quobyte-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50" released by "delete_volume" :: held 0.977s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:44 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-a4d4a189-90fd-41bd-b7d9-a32ffff4886d tempest-CinderUnicodeTest-1800741968 None] Created reservations ['12601a4e-e925-4b49-ab41-514d197ee98a', '0e61730e-4b11-472b-8728-2b5b879d356a', 'ec5edae3-d301-4b4e-b063-dd885c3c6284', '8aa618c6-1d0f-4484-8754-084164255e00'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a4d4a189-90fd-41bd-b7d9-a32ffff4886d tempest-CinderUnicodeTest-1800741968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a4d4a189-90fd-41bd-b7d9-a32ffff4886d tempest-CinderUnicodeTest-1800741968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:44 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a4d4a189-90fd-41bd-b7d9-a32ffff4886d tempest-CinderUnicodeTest-1800741968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:44 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-a4d4a189-90fd-41bd-b7d9-a32ffff4886d tempest-CinderUnicodeTest-1800741968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-a4d4a189-90fd-41bd-b7d9-a32ffff4886d tempest-CinderUnicodeTest-1800741968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a4d4a189-90fd-41bd-b7d9-a32ffff4886d tempest-CinderUnicodeTest-1800741968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:44 devstack sudo[89758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:42:44 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:44 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-0770b1a2-48af-4559-9f2e-78f525a81a49 tempest-CinderUnicodeTest-1800741968 None] Acquiring lock "cinder-96bcb133-b998-4b3e-a639-1ab3d9be1f1a-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:44 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-0770b1a2-48af-4559-9f2e-78f525a81a49 tempest-CinderUnicodeTest-1800741968 None] Lock "cinder-96bcb133-b998-4b3e-a639-1ab3d9be1f1a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:44 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-0770b1a2-48af-4559-9f2e-78f525a81a49 tempest-CinderUnicodeTest-1800741968 None] Acquiring lock "cinder-quobyte-96bcb133-b998-4b3e-a639-1ab3d9be1f1a" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:44 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:44 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-0770b1a2-48af-4559-9f2e-78f525a81a49 tempest-CinderUnicodeTest-1800741968 None] Lock "cinder-quobyte-96bcb133-b998-4b3e-a639-1ab3d9be1f1a" acquired by "delete_volume" :: waited 0.011s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557.fb54e28c-e456-4249-806b-1e46d4f5c116" returned: 0 in 0.530s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:44 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb90916b-f37c-4ca4-81d9-321cc5c27557(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:42:44 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557 {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:42:44 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Creating direct copy from snapshot {{(pid=81938) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:42:44 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17621fd-3fa8-4260-91c2-431205450079]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0770b1a2-48af-4559-9f2e-78f525a81a49 tempest-CinderUnicodeTest-1800741968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-96bcb133-b998-4b3e-a639-1ab3d9be1f1a {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:44 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7418f5-f23c-46dc-9b8d-25460d82ea43]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:44 devstack sudo[89760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-96bcb133-b998-4b3e-a639-1ab3d9be1f1a Apr 10 10:42:44 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:44 devstack sudo[89761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557 Apr 10 10:42:44 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:44 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-a4d4a189-90fd-41bd-b7d9-a32ffff4886d tempest-CinderUnicodeTest-1800741968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.475s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:44 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-a4d4a189-90fd-41bd-b7d9-a32ffff4886d tempest-CinderUnicodeTest-1800741968 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:44 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-a4d4a189-90fd-41bd-b7d9-a32ffff4886d tempest-CinderUnicodeTest-1800741968 None] Deleted volume successfully. Apr 10 10:42:44 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-a4d4a189-90fd-41bd-b7d9-a32ffff4886d tempest-CinderUnicodeTest-1800741968 None] Lock "cinder-e33eb9cf-8bd1-4d2c-92c0-c192c070cd50-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:44 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0770b1a2-48af-4559-9f2e-78f525a81a49 tempest-CinderUnicodeTest-1800741968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-96bcb133-b998-4b3e-a639-1ab3d9be1f1a" returned: 0 in 0.488s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0770b1a2-48af-4559-9f2e-78f525a81a49 tempest-CinderUnicodeTest-1800741968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-96bcb133-b998-4b3e-a639-1ab3d9be1f1a {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:44 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557" returned: 0 in 0.497s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:44 devstack sudo[89771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-96bcb133-b998-4b3e-a639-1ab3d9be1f1a Apr 10 10:42:44 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:44 devstack cinder-volume[81938]: DEBUG cinder.utils [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Path /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-131c80fa-3737-40a0-abb8-427ae10d8631 not found in is_blk_device check {{(pid=81938) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:42:44 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-131c80fa-3737-40a0-abb8-427ae10d8631 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:44 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-131c80fa-3737-40a0-abb8-427ae10d8631 Apr 10 10:42:44 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:45 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0770b1a2-48af-4559-9f2e-78f525a81a49 tempest-CinderUnicodeTest-1800741968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-96bcb133-b998-4b3e-a639-1ab3d9be1f1a" returned: 0 in 0.430s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:45 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-0770b1a2-48af-4559-9f2e-78f525a81a49 tempest-CinderUnicodeTest-1800741968 None] Lock "cinder-quobyte-96bcb133-b998-4b3e-a639-1ab3d9be1f1a" released by "delete_volume" :: held 0.950s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:45 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-0770b1a2-48af-4559-9f2e-78f525a81a49 tempest-CinderUnicodeTest-1800741968 None] Created reservations ['86a71ba2-d842-4d89-b768-4cca4b87a7f8', 'ae7f9240-6d91-43c1-b22a-eb3aba8e2a52', 'bdc35e54-f563-4726-b6f7-beac20a8f5ad', 'd8f43c11-1d92-4e4a-89d0-55bf0f321ed5'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0770b1a2-48af-4559-9f2e-78f525a81a49 tempest-CinderUnicodeTest-1800741968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0770b1a2-48af-4559-9f2e-78f525a81a49 tempest-CinderUnicodeTest-1800741968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:45 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0770b1a2-48af-4559-9f2e-78f525a81a49 tempest-CinderUnicodeTest-1800741968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:45 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0770b1a2-48af-4559-9f2e-78f525a81a49 tempest-CinderUnicodeTest-1800741968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0770b1a2-48af-4559-9f2e-78f525a81a49 tempest-CinderUnicodeTest-1800741968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:45 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0770b1a2-48af-4559-9f2e-78f525a81a49 tempest-CinderUnicodeTest-1800741968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:45 devstack sudo[89786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:42:45 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:46 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0770b1a2-48af-4559-9f2e-78f525a81a49 tempest-CinderUnicodeTest-1800741968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 1.130s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:46 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-0770b1a2-48af-4559-9f2e-78f525a81a49 tempest-CinderUnicodeTest-1800741968 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:46 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-0770b1a2-48af-4559-9f2e-78f525a81a49 tempest-CinderUnicodeTest-1800741968 None] Deleted volume successfully. Apr 10 10:42:46 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-0770b1a2-48af-4559-9f2e-78f525a81a49 tempest-CinderUnicodeTest-1800741968 None] Lock "cinder-96bcb133-b998-4b3e-a639-1ab3d9be1f1a-delete_volume" released by "delete_volume" :: held 2.468s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:46 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-131c80fa-3737-40a0-abb8-427ae10d8631" returned: 0 in 1.935s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:46 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[64aba07f-4a35-4dbb-8742-dd89a609ad05]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:46 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:46 devstack sudo[89789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557 Apr 10 10:42:46 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:47 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557" returned: 0 in 0.636s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:47 devstack cinder-volume[81938]: DEBUG cinder.image.image_utils [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557, size 1024.00 MB, duration 1.94 sec, destination /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-131c80fa-3737-40a0-abb8-427ae10d8631 {{(pid=81938) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:42:47 devstack cinder-volume[81938]: INFO cinder.image.image_utils [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Converted 1024.00 MB image at 528.83 MB/s Apr 10 10:42:47 devstack cinder-volume[81938]: WARNING cinder.volume.drivers.remotefs [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-131c80fa-3737-40a0-abb8-427ae10d8631 is being set with open permissions: ugo+rw Apr 10 10:42:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-131c80fa-3737-40a0-abb8-427ae10d8631 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:47 devstack sudo[89794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-131c80fa-3737-40a0-abb8-427ae10d8631 Apr 10 10:42:47 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:47 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-131c80fa-3737-40a0-abb8-427ae10d8631" returned: 0 in 0.423s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:47 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Lock "cinder-quobyte-131c80fa-3737-40a0-abb8-427ae10d8631" released by "_copy_volume_from_snapshot" :: held 4.084s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:47 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Lock "cinder-quobyte-fb54e28c-e456-4249-806b-1e46d4f5c116-131c80fa-3737-40a0-abb8-427ae10d8631" released by "_create_volume_from_snapshot" :: held 4.100s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:47 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.121s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (709aa788-5c72-4f24-ae6c-912141e43c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-131c80fa-3737-40a0-abb8-427ae10d8631', 'volume_size': 1, 'snapshot_id': 'fb54e28c-e456-4249-806b-1e46d4f5c116'}' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc619bd9-f4d8-441c-bf76-bd36e590a6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:47 devstack cinder-volume[81938]: INFO cinder.volume.flows.manager.create_volume [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Volume volume-131c80fa-3737-40a0-abb8-427ae10d8631 (131c80fa-3737-40a0-abb8-427ae10d8631): created successfully Apr 10 10:42:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc619bd9-f4d8-441c-bf76-bd36e590a6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81938) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:47 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Flow 'volume_create_manager' (c400ab0a-923d-40eb-90c7-df0474971623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81938) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:47 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-390502fb-22d5-4960-80f3-b19316528816 tempest-SnapshotDependencyTests-121212392 None] Created volume successfully. Apr 10 10:42:48 devstack cinder-volume[81938]: DEBUG oslo_service.periodic_task [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81938) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:42:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:48 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:48 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:42:48 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:48 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:48 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.405s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:48 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-7f9f2b1b-16b2-4365-a76a-249b43717ca3 None None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:49 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-777c0480-b5c8-465c-9f8a-acdfe0b41516 tempest-SnapshotDependencyTests-121212392 None] Acquiring lock "cinder-fb54e28c-e456-4249-806b-1e46d4f5c116-delete_snapshot" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:49 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-777c0480-b5c8-465c-9f8a-acdfe0b41516 tempest-SnapshotDependencyTests-121212392 None] Lock "cinder-fb54e28c-e456-4249-806b-1e46d4f5c116-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:49 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-777c0480-b5c8-465c-9f8a-acdfe0b41516 tempest-SnapshotDependencyTests-121212392 None] Acquiring lock "cinder-quobyte-eb90916b-f37c-4ca4-81d9-321cc5c27557" by "delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:49 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-777c0480-b5c8-465c-9f8a-acdfe0b41516 tempest-SnapshotDependencyTests-121212392 None] Lock "cinder-quobyte-eb90916b-f37c-4ca4-81d9-321cc5c27557" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:49 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-777c0480-b5c8-465c-9f8a-acdfe0b41516 tempest-SnapshotDependencyTests-121212392 None] Acquiring lock "cinder-quobyte-fb54e28c-e456-4249-806b-1e46d4f5c116" by "_delete_snapshot" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:49 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-777c0480-b5c8-465c-9f8a-acdfe0b41516 tempest-SnapshotDependencyTests-121212392 None] Lock "cinder-quobyte-fb54e28c-e456-4249-806b-1e46d4f5c116" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:49 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-777c0480-b5c8-465c-9f8a-acdfe0b41516 tempest-SnapshotDependencyTests-121212392 None] Deleting offline snapshot fb54e28c-e456-4249-806b-1e46d4f5c116 of volume eb90916b-f37c-4ca4-81d9-321cc5c27557 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:42:49 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-777c0480-b5c8-465c-9f8a-acdfe0b41516 tempest-SnapshotDependencyTests-121212392 None] snapshot_file for this snap is: volume-eb90916b-f37c-4ca4-81d9-321cc5c27557.fb54e28c-e456-4249-806b-1e46d4f5c116 {{(pid=81938) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:42:49 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[520e5717-fcd0-473b-8af1-b493f6769073]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-777c0480-b5c8-465c-9f8a-acdfe0b41516 tempest-SnapshotDependencyTests-121212392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557.fb54e28c-e456-4249-806b-1e46d4f5c116 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:49 devstack sudo[89806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557.fb54e28c-e456-4249-806b-1e46d4f5c116 Apr 10 10:42:49 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:49 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-777c0480-b5c8-465c-9f8a-acdfe0b41516 tempest-SnapshotDependencyTests-121212392 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557.fb54e28c-e456-4249-806b-1e46d4f5c116" returned: 0 in 0.481s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:49 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.remotefs [None req-777c0480-b5c8-465c-9f8a-acdfe0b41516 tempest-SnapshotDependencyTests-121212392 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb90916b-f37c-4ca4-81d9-321cc5c27557(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81938) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:42:49 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6c8343-f2a0-4fb0-876f-b29074fd000e]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:49 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-777c0480-b5c8-465c-9f8a-acdfe0b41516 tempest-SnapshotDependencyTests-121212392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:49 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557 Apr 10 10:42:49 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:50 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-777c0480-b5c8-465c-9f8a-acdfe0b41516 tempest-SnapshotDependencyTests-121212392 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557" returned: 0 in 0.479s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-777c0480-b5c8-465c-9f8a-acdfe0b41516 tempest-SnapshotDependencyTests-121212392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557.fb54e28c-e456-4249-806b-1e46d4f5c116 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:50 devstack sudo[89817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557.fb54e28c-e456-4249-806b-1e46d4f5c116 Apr 10 10:42:50 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:50 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-777c0480-b5c8-465c-9f8a-acdfe0b41516 tempest-SnapshotDependencyTests-121212392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557.fb54e28c-e456-4249-806b-1e46d4f5c116" returned: 0 in 0.444s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-777c0480-b5c8-465c-9f8a-acdfe0b41516 tempest-SnapshotDependencyTests-121212392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557.fb54e28c-e456-4249-806b-1e46d4f5c116 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:50 devstack sudo[89822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557.fb54e28c-e456-4249-806b-1e46d4f5c116 Apr 10 10:42:50 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:50 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:50 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-777c0480-b5c8-465c-9f8a-acdfe0b41516 tempest-SnapshotDependencyTests-121212392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557.fb54e28c-e456-4249-806b-1e46d4f5c116" returned: 0 in 0.386s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:50 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-777c0480-b5c8-465c-9f8a-acdfe0b41516 tempest-SnapshotDependencyTests-121212392 None] Lock "cinder-quobyte-fb54e28c-e456-4249-806b-1e46d4f5c116" released by "_delete_snapshot" :: held 1.839s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:50 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-777c0480-b5c8-465c-9f8a-acdfe0b41516 tempest-SnapshotDependencyTests-121212392 None] Lock "cinder-quobyte-eb90916b-f37c-4ca4-81d9-321cc5c27557" released by "delete_snapshot" :: held 1.855s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:50 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-777c0480-b5c8-465c-9f8a-acdfe0b41516 tempest-SnapshotDependencyTests-121212392 None] Created reservations ['4e457d5c-fa74-44b9-8527-683765d7d18c', 'ab51e2c0-8fae-4506-8ed6-a500393842fe', '04723a5c-713a-402b-9a40-876a4cbfb56a', '092633e5-00ef-4158-90c1-1b577f7212ac'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:50 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-777c0480-b5c8-465c-9f8a-acdfe0b41516 tempest-SnapshotDependencyTests-121212392 None] Delete snapshot completed successfully. Apr 10 10:42:50 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-777c0480-b5c8-465c-9f8a-acdfe0b41516 tempest-SnapshotDependencyTests-121212392 None] Lock "cinder-fb54e28c-e456-4249-806b-1e46d4f5c116-delete_snapshot" released by "delete_snapshot" :: held 1.947s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:51 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-3f1eb996-bec1-4442-b37d-325a72fb63e2 tempest-SnapshotDependencyTests-121212392 None] Acquiring lock "cinder-eb90916b-f37c-4ca4-81d9-321cc5c27557-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:51 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-3f1eb996-bec1-4442-b37d-325a72fb63e2 tempest-SnapshotDependencyTests-121212392 None] Lock "cinder-eb90916b-f37c-4ca4-81d9-321cc5c27557-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:51 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-3f1eb996-bec1-4442-b37d-325a72fb63e2 tempest-SnapshotDependencyTests-121212392 None] Acquiring lock "cinder-quobyte-eb90916b-f37c-4ca4-81d9-321cc5c27557" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:51 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-3f1eb996-bec1-4442-b37d-325a72fb63e2 tempest-SnapshotDependencyTests-121212392 None] Lock "cinder-quobyte-eb90916b-f37c-4ca4-81d9-321cc5c27557" acquired by "delete_volume" :: waited 0.008s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:51 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc50f0de-d8aa-4275-b16b-f1a6d7d58baa]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3f1eb996-bec1-4442-b37d-325a72fb63e2 tempest-SnapshotDependencyTests-121212392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:51 devstack sudo[89825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557 Apr 10 10:42:51 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:51 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3f1eb996-bec1-4442-b37d-325a72fb63e2 tempest-SnapshotDependencyTests-121212392 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557" returned: 0 in 0.452s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:51 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3f1eb996-bec1-4442-b37d-325a72fb63e2 tempest-SnapshotDependencyTests-121212392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:51 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557 Apr 10 10:42:51 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:52 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3f1eb996-bec1-4442-b37d-325a72fb63e2 tempest-SnapshotDependencyTests-121212392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-eb90916b-f37c-4ca4-81d9-321cc5c27557" returned: 0 in 0.389s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:52 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-3f1eb996-bec1-4442-b37d-325a72fb63e2 tempest-SnapshotDependencyTests-121212392 None] Lock "cinder-quobyte-eb90916b-f37c-4ca4-81d9-321cc5c27557" released by "delete_volume" :: held 0.867s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:52 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-3f1eb996-bec1-4442-b37d-325a72fb63e2 tempest-SnapshotDependencyTests-121212392 None] Created reservations ['13dba428-62b8-478b-8e66-1c26c0efb96e', 'cbdb9c84-897a-4868-9f1b-91a201f93c18', '5addec9f-f0be-442e-ac5b-ba33af2904f8', 'b70db0a0-d249-4384-bc32-3bbefb9ae9b9'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3f1eb996-bec1-4442-b37d-325a72fb63e2 tempest-SnapshotDependencyTests-121212392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3f1eb996-bec1-4442-b37d-325a72fb63e2 tempest-SnapshotDependencyTests-121212392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:52 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3f1eb996-bec1-4442-b37d-325a72fb63e2 tempest-SnapshotDependencyTests-121212392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:52 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-3f1eb996-bec1-4442-b37d-325a72fb63e2 tempest-SnapshotDependencyTests-121212392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-3f1eb996-bec1-4442-b37d-325a72fb63e2 tempest-SnapshotDependencyTests-121212392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3f1eb996-bec1-4442-b37d-325a72fb63e2 tempest-SnapshotDependencyTests-121212392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:52 devstack sudo[89833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:42:52 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:52 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-0e6fc702-32af-4d14-aa2c-c1710a807dfe tempest-SnapshotDependencyTests-121212392 None] Acquiring lock "cinder-131c80fa-3737-40a0-abb8-427ae10d8631-delete_volume" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:52 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-0e6fc702-32af-4d14-aa2c-c1710a807dfe tempest-SnapshotDependencyTests-121212392 None] Lock "cinder-131c80fa-3737-40a0-abb8-427ae10d8631-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:52 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-0e6fc702-32af-4d14-aa2c-c1710a807dfe tempest-SnapshotDependencyTests-121212392 None] Acquiring lock "cinder-quobyte-131c80fa-3737-40a0-abb8-427ae10d8631" by "delete_volume" {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:52 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-0e6fc702-32af-4d14-aa2c-c1710a807dfe tempest-SnapshotDependencyTests-121212392 None] Lock "cinder-quobyte-131c80fa-3737-40a0-abb8-427ae10d8631" acquired by "delete_volume" :: waited 0.009s {{(pid=81938) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:52 devstack cinder-volume[81938]: DEBUG oslo.privsep.daemon [-] privsep: reply[183655ba-9272-432c-951d-a610404bcc37]: (4, 'qcow2') {{(pid=82756) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0e6fc702-32af-4d14-aa2c-c1710a807dfe tempest-SnapshotDependencyTests-121212392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-131c80fa-3737-40a0-abb8-427ae10d8631 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:52 devstack sudo[89835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-131c80fa-3737-40a0-abb8-427ae10d8631 Apr 10 10:42:52 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:52 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-3f1eb996-bec1-4442-b37d-325a72fb63e2 tempest-SnapshotDependencyTests-121212392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.419s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:52 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-3f1eb996-bec1-4442-b37d-325a72fb63e2 tempest-SnapshotDependencyTests-121212392 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:52 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-3f1eb996-bec1-4442-b37d-325a72fb63e2 tempest-SnapshotDependencyTests-121212392 None] Deleted volume successfully. Apr 10 10:42:52 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-3f1eb996-bec1-4442-b37d-325a72fb63e2 tempest-SnapshotDependencyTests-121212392 None] Lock "cinder-eb90916b-f37c-4ca4-81d9-321cc5c27557-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:52 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0e6fc702-32af-4d14-aa2c-c1710a807dfe tempest-SnapshotDependencyTests-121212392 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-131c80fa-3737-40a0-abb8-427ae10d8631" returned: 0 in 0.453s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:52 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0e6fc702-32af-4d14-aa2c-c1710a807dfe tempest-SnapshotDependencyTests-121212392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-131c80fa-3737-40a0-abb8-427ae10d8631 {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:52 devstack sudo[89841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-131c80fa-3737-40a0-abb8-427ae10d8631 Apr 10 10:42:52 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:53 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0e6fc702-32af-4d14-aa2c-c1710a807dfe tempest-SnapshotDependencyTests-121212392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c/volume-131c80fa-3737-40a0-abb8-427ae10d8631" returned: 0 in 0.423s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:53 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-0e6fc702-32af-4d14-aa2c-c1710a807dfe tempest-SnapshotDependencyTests-121212392 None] Lock "cinder-quobyte-131c80fa-3737-40a0-abb8-427ae10d8631" released by "delete_volume" :: held 0.900s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:53 devstack cinder-volume[81938]: DEBUG cinder.quota [None req-0e6fc702-32af-4d14-aa2c-c1710a807dfe tempest-SnapshotDependencyTests-121212392 None] Created reservations ['3e8a38cb-dc38-4d70-8843-290191f3d783', 'a1a43c93-b9ac-46ca-8a4b-a8bf5c909dde', 'de2fd3a0-23ed-42e0-aab9-db3b4221c83f', '6eb3ed56-2908-4d60-8f5a-9c86b1a3d2bc'] {{(pid=81938) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0e6fc702-32af-4d14-aa2c-c1710a807dfe tempest-SnapshotDependencyTests-121212392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0e6fc702-32af-4d14-aa2c-c1710a807dfe tempest-SnapshotDependencyTests-121212392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:53 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0e6fc702-32af-4d14-aa2c-c1710a807dfe tempest-SnapshotDependencyTests-121212392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4': None} {{(pid=81938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:53 devstack cinder-volume[81938]: DEBUG cinder.volume.drivers.quobyte [None req-0e6fc702-32af-4d14-aa2c-c1710a807dfe tempest-SnapshotDependencyTests-121212392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3b07848c-d097-4e4c-be14-c3f6569225c4'] {{(pid=81938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [None req-0e6fc702-32af-4d14-aa2c-c1710a807dfe tempest-SnapshotDependencyTests-121212392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81938) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0e6fc702-32af-4d14-aa2c-c1710a807dfe tempest-SnapshotDependencyTests-121212392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:53 devstack sudo[89844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c Apr 10 10:42:53 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:53 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:53 devstack cinder-volume[81938]: DEBUG oslo_concurrency.processutils [None req-0e6fc702-32af-4d14-aa2c-c1710a807dfe tempest-SnapshotDependencyTests-121212392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1baa4cc392d670f6084829c7e3a038c" returned: 0 in 0.451s {{(pid=81938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:53 devstack cinder-volume[81938]: DEBUG cinder.manager [None req-0e6fc702-32af-4d14-aa2c-c1710a807dfe tempest-SnapshotDependencyTests-121212392 None] Notifying Schedulers of capabilities ... {{(pid=81938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:53 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-0e6fc702-32af-4d14-aa2c-c1710a807dfe tempest-SnapshotDependencyTests-121212392 None] Deleted volume successfully. Apr 10 10:42:53 devstack cinder-volume[81938]: DEBUG cinder.coordination [None req-0e6fc702-32af-4d14-aa2c-c1710a807dfe tempest-SnapshotDependencyTests-121212392 None] Lock "cinder-131c80fa-3737-40a0-abb8-427ae10d8631-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=81938) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:03 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writing DB stats cinder:SELECT=29,cinder:INSERT=8,cinder:UPDATE=30,cinder:DELETE=4 {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:43:03 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writing DB stats cinder:UPDATE=50,cinder:SELECT=27,cinder:INSERT=12,cinder:DELETE=1 {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}